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RELATED APPLICATIONS 

y The present apphcation is a continuation-in-part of co-pending and commonly 

3 assigned United States patent application Serial No. 09/352,795 entitled SYSTEM AND 
METHOD FOR PACKET NETWORK MEDIA REDIRECTION, filed July 13,1 999, the 
disclosure of which is hereby incorporated herein by reference. This application is related to 
5 co-pending, and commonly assigned United States patent apphcation Serial No. [47524- 

P104C1-09908774] entitled SYSTEM AND METHOD FOR PACKET NETWORK MEDIA 
REDIRECTION, which is a continuation of United States patent application Serial No. 
09/352,795, entitled SYSTEM AND METHOD FOR PACKET NETWORK MEDIA 
REDIRECTION, filed July 13, 1999, the disclosure of which is hereby incorporated herein 
1 0 by reference. This application is also related to the following commonly assigned, 
co-pending patent applications: Serial No. 08/719,163, entitled INTERACTIVE 
INFORMATION TRANSACTION PROCESSING SYSTEM WITH UNIVERSAL 
TELEPHONY GATEWAY CAPABILITIES, filed 09/24/96; Serial No. 08/846,961, entitled 
SWITCHLESS CALL PROCESSING, filed 04/29/97; and Serial No. 09/163,234, entitled 
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INTERACTIVE INFORMATION TRANSACTION PROCESSING SYSTEM ON IP 
TELEPHONY PLATFORM, filed 09/29/98, which is a continuation of application Serial No. 
08/719,163; all of which appUcations are hereby incorporated herein by reference. 

TECHNICAL FIELD 
This invention relates generally to a system and method for facilitating the transfer of 
information via an asynchronous packet network, and more particularly to a system and 
method for redirecting media in an asynchronous packet network. 
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BACKGROUND 

Voice Response Units ("VRUs") have existed in the prior art for many years, and are 
generally defined as robotic systems that automatically interact with one or more persons for 
the exchange of information and the enhancement of communications. There are numerous 
5 enhanced services capable of being provided by a VRU, including voice messaging, 

automated collect caUing, international callback, prepaid & postpaid calling card, store & 
forward, one number service, find me, follow me, 800/900 service, automated customer 
service, automated agents or attendants, voice activated dialing, prepaid & postpaid wireless, 
conferencing, and other such enhanced services. 
30 In the prior art, synchronously switched VRUs were initially connected to the Plain 

?i Old Telephone System ("POTS") network (i.e., the PubUc Switched Telephone Network 

W ("PSTN")) via analog interfaces. Although POTS analog connections still exist, the use of 

m digitized voice transmission is becoming increasingly common on the PSTN. Because of the 

advantages of digitized transmission, a synchronous VRU is now typically connected to the 
H5 POTS network via a digital interface, as disclosed in co-assigned U.S. Patent No. 5,81 8,912, 
U entitled FULLY DIGITAL CALL PROCESSING PLATFORM, by Daniel Hammond, issued 

O October 6, 1998, which application is incorporated herein by reference. An example of such 

^ a VRU is shown in FIGURE 1, wherein synchronous VRU 100 is digitally connected to 

PSTN 102 via Tl trunk 104 using a standard Integrated Services Digital Network ("ISDN") 
20 format. Digitized voice signals transmitted over the PSTN normally consume approximately 
64 Kilobits-per-second ("Kbps") of bandwidth when digitized and encoded according to the 
G.71 1 compressed format using pulse code modulation ("PCM") and the standard |i-law or 
A-law logarithmic algorithms. 

Generally, in the prior art, the PSTN was originally designed to be managed and 
25 controlled by a single entity, and later developed such that very few entities control the 

primary switches that make up the network infrastructure. Generally, because control of the 
network is centered inside the PSTN switches and because the PSTN switches are of a 
proprietary nature, very little control over the switching mechanisms is available to other 
entities that do not own the switches in the network. For example, each specific connection 
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made by VRU 100, e.g., to telephone 106a, generally requires its own port and a 64 Kbps 
channel. If the enhanced service being provided by VRU 100 requires connecting telephone 
106a to another device external to VRU 100, for example to telephone 106c, there are limited 
options available to VRU 100, each with its own tradeoffs as explained below. 

First, PSTN 102 may transfer a call via Release Link Trunking ("RLT") by sending 
control signals to a switch in the network. For example, a calling party using telephone 106a 
may wish to call another party at telephone 106c using an 800 calling card service provided 
by VRU 100. After the calling party enters a Card Number, personal identification number 
("PIN") and the phone number for telephone 106c, VRU 100 verifies the information and 
then connects the two parties using RLT by placing a second call via PSTN 102 and then 
connecting the two parties. In using RLT, VRU 100 gives up control of the call to PSTN 
102, although VRU 100 may send the customer's card number and PIN or a call identifier to 
PSTN 102 for tracking purposes. 

Generally, a useful and desirable 800 calling card service feature known as call 
re-origination allows the calling party to disconnect from the called party and reconnect to 
another called party without breaking the caUing party's initial connection. Typically, the 
calling party on telephone 106a may hold down the # key for more than two seconds to signal 
to the network the calling party's desire to make a new call, although many other signals and 
durations may be used. Because VRU 100 has relinquished control of the call to PSTN 102, 
PSTN 102 must monitor the call for the # key dual-tone multi-frequency ("DTMF") signal so 
that PSTN 102 may then reconnect the calling party on telephone 106a to VRU 100. PSTN 
102 also sends the customer ID and PIN or call identifier back to VRU 100 so that the 
customer does not have to reenter this information. This approach has the advantage of 
freeing up the VRU ports for other callers, but it requires PSTN 102 to have an apphcation 
running for tracking the customer's ID and PIN, and for monitoring the call for DTMF 
signals. 

Second, a user such as VRU 100 may use a hook flash and redial to request that PSTN 
102 directly connect telephone 106a to telephone 106c. This also has the advantage of 
freeing up ports on VRU 100, but VRU 100 permanently loses the call context. Unlike RLT, 
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the hook flash does not allow VRU 100 to retrieve the call context from PSTN 102. The 
VRU then cannot perform important call control or administrative functions such as 
monitoring, recording, timing, or charging for the phone call. Because the call context is lost 
for VRU 100, the calling party generally must reenter the Card Number and PIN, in addition 
5 to the new destination phone number, and VRU 1 00 must re-verify the calling party's 

information. Reentering these numbers can be frustrating to customers, and consvimes extra 
connection time and processing resources. 

Alternatively, the connection between the two parties may be bridged between the 
telephones within VRU 100. Internal synchronous switch 112 and another port and 64 Kbps 
^0 channel are required to complete the connection to telephone 106c. VRU 100 does not 

relinquish control of the call to PSTN 102, so VRU 100 may still perform call control and 
lU administrative functions. In addition, VRU 100 may monitor the call for DTMF signals. If 

Si the calling party using an 800 calling card service wishes to make another call, the calUng 

party may hold the # key for more than two seconds. VRU 100 detects this signal directly, 
as and can disconnect the called party on one port from the calling party on the other port, 
[y Because VRU 100 maintained the call context, the calling party's Card Number and PIN do 

S not have to be reentered and re-verified. The calling party may simply enter the new 

1"=^ destmation phone number, and VRU 100 may then set up a new connection using another 

port. However, this alternative requires VRU 100 to implement intemal switch 112, and uses 
20 two circuits in the network and two ports on VRU 100, one for each party. Thus the VRU 
ports generally stay engaged for the entire duration of the phone call, instead of being made 
available for use on other phone calls. This is undesirable because unlike a simple switch, 
VRU ports are generally expensive resources that provide enhanced functions, such as voice 
recognition, DTMF detection/generation or text-to-speech conversion, for interacting with 
25 callers. Normally, the network owners would like to always keep the VRU port busy 

handling new calls. However, since the VRU ports are used to access the intemal switch, the 
VRU ports are engaged during the entire call, even though the port is idle. 

In addition to intemal switch 1 12 and extra network bandwidth used, a VRU bridged 
connection may also travel over an inordinate amount of distance. For example, a calling 
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party in Houston, Texas, may wish to call another party in New Orleans, Louisiana, using an 
800 calling card service provided by a VRU. If the VRU is located in either of those cities, 
then the bridged call does not travel much extra distance compared to the physical distance 
between the actual parties. If the VRU is located in Los Angeles, Cahfomia, however, the 
5 inboimd call to the VRU must travel all the way to Los Angeles from Houston, and the 
outbound call from the VRU must travel all the way to New Orleans from Los Angeles, 
which is an inefficient use of network resources. 

Other problems with synchronously switched networks exist. They generally are 
Q expensive to build, difficult to upgrade once built, and not flexible enough to support new 
So multimedia services. In response to these difficulties, along with other factors, there has been 

a dramatic increase in recent years of the availability of public packet networks, such as the 
Cm Internet, other wide area networks ("WANs"), and local area networks ("LANs"), to 

y exchange information, for example, in voice format. PSTN circuits generally multiplex 

L digitized voice signals by allocating sequential bits or words in separate conversations to 

H5 periodic time slots in a time division multiple access ("TDMA") structure. The PSTN 
O requires a switched architecture and point-to-point connections, and the data is transmitted 

Ir: continuously, so PSTN connections use up bandwidth needlessly when voices are silent 

during a call. On the other hand, packet networks asynchronously send digitized signals in 
packetized form, where each packet is encoded with a header that references its destination 
20 and sequence. The packets are only sent when there is information to send, thus packet 

networks do not need to send packets when the callers' voices are silent, saving bandwidth. 

In a packet network, the packets may follow one of many possible pathways to their 
destinations before they are reassembled, according to their headers, into a conversation. 
Generally, this has the disadvantage over the POTS/TDMA method in that the packet headers 
25 consume additional bandwidth. The packet header disadvantage is generally believed to be 
outweighed by the efficiencies in network usage without switched architecture and point-to- 
point connections because, for example, a synchronous network continuously uses the same 
bandwidth even if there is no substantive signal to transmit. 
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In part to promote interoperability in the fast developing packet network technology 
area, the International Telecommunications Union ("ITU")? located in Geneva, Switzerland 
and with a World Wide Web ("WWW") site of "http://www.itu.org;' has developed the 
H,323 standard for real-time multimedia (defined herein as including voice, video, data, or 
5 any combination thereof) communications and conferencing for packet-based networks. The 
H.323 standard, entitled "Packet-based Multimedia Communications Systems," released 
February 1998, is incorporated herein by reference, and is actually an umbrella standard for a 
series of specifications that describe how multimedia communications occur between 
terminals, network equipment and services on packet networks (e.g., Internet Protocol ("IP") 
'^0 networks), some of which do not provide a guaranteed Quality of Service ("QoS"). The 
"^^J standard is based on the Internet Engineering Task Force ("IETF") real-time transport 

fU protocol ("RTP") and real-time transport control protocol ("RTCP"), with additional 

protocols for call signaling and data and audiovisual communications. Another protocol, the 
'^'^ resource reservation protocol ("RSVP"), may be implemented in routers to establish and 

05 maintain requested transmission paths and QoS levels. Generally, a protocol that guarantees 
I y a QoS level has mechanisms for ensuring the on-time delivery of traffic signals, recovering 

lost packets, and guaranteeing bandwidth availability for specific applications. 
1^^ Some of the specifications referenced by the H.323 standard include call control and 

fi*aming specifications, such as H.225, Q.931, and H.245, audio codec specifications, such as 
20 G.71 1 for high bit rate connections and G.723 for low-bit-rate connections, video codec 
specifications, such as H.261 for high bit rate connections and H.263 for low-bit-rate 
connections, and data communications specifications, such as T.120 standards. The H.323 
standard defines several entities that may exist on a packet network: terminals, Multipoint 
Control Units ("MCUs"), gatekeepers, and gateways. Terminals support at least voice 
25 communications and optionally support multimedia communications, and include such 

components as personal computers and IP phones with at least voice capability and optionally 
multimedia capabiUty. MCUs support conferencing for three or more network endpoints. 
Gatekeepers provide network management and virtual Private Branch Exchange 
("PBX")-type capabilities, such as call control services like address translation for network 
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endpoints. Gateways support at least voice and optionally multimedia inter-networking for 
connecting IP packet-based networks with circuit-switched networks, and provide translations 
between different transmission formats, communications procedures, and codecs. 

A synchronous VRU may interface with an asynchronous packet network via a 
5 PSTN/packet gateway. A PSTN/packet gateway converts TDMA voice signals received, for 
example, over a standard PSTN line, into packetized voice signals, and vice versa, and allows 
the resources in the PSTN network to exchange information with resources in the packet 
network. Generally, the PSTN/packet gateway also performs conversion of analog signals to 
.p., digital signals (if required), or accepts the ^-law encoded digital signals directly from the 

^0 PSTN. The gateway may optionally compress the digitized signals from [x-law (about 64 
H Kbps) down to as low as about 5 Kbps before packetizing (and vice versa). The packetized 

voice signals may be multiplexed with numerous other signals for transmission over a data 
;J~ line. A typical application of such a PSTN/packet gateway is providing an alternative to 

making a long distance call Instead of making a long distance connection where the network 
|45 uses digital TDMA lines at approximately 64 Kbps of bandwidth per call, callers may make a 
J2 local POTS call to a PSTN/packet gateway. The gateway may digitize, if necessary, and 

^ optionally compress the incoming signal down to about 5 or 6 Kbps. The gateway then 

packetizes the signal. These packetized signals may then be multiplexed and routed in bulk 
very cheaply over long distances on a data grade network. At the other end, another 
20 PSTN/packet gateway receives and reassembles the packetized signal, and then decompresses 
the signal, if necessary, and converts it back into a TDMA-multiplexed signal. Resources at 
the distant gateway then make another local POTS call to complete the connection between 
the calling party and the receiving party. 

A synchronous VRU connected to a PSTN/packet gateway may provide the enhanced 
25 services described above, and take advantage of the additional capabihties of the packet 

network. Such a system is one of the systems discussed in co-assigned, co-pending patent 
appUcation Serial No. 08/719,163, entitled INTERACTIVE INFORMATION 
TRANSACTION PROCESSING SYSTEM WITH UNIVERSAL TELEPHONY 
GATEWAY CAPABILITIES, by Michael Polcyn, filed 09/24/96. An example of such a 
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system is shown in FIGURE 2, As discussed in application Serial No. 08/719,163, the VRU 
(i.e.. Interactive Voice Response Unit ("IVR")) may be an automated voice resource known 
in the art, such as the "One Voice" or "IN*Contror' platforms, available from InterVoice, Inc., 
1781 1 Waterview Parkway, Dallas, Texas, 75252. Ports on the VRU receive individual 
5 communications, and resources in the VRU perform processing to make communications in 
one format (e.g., asynchronous data in the packet network) imderstandable to 
communications in other formats (e.g. synchronous data in the POTS network). 

In the example system shown in FIGURE 2, synchronous VRU 200 connects to PSTN 
202 via Tl trunk 204, as in FIGURE 1, In addition, VRU 200 connects to PSTN/packet 
JlO gateway 214 via Tl trunk 212, and gateway 214 is connected asynchronously to packet 
ji network 216. If telephone 21 8 is physically located in a different area than VRU 200, access 

rU to VRU 200 via the POTS network may require a long distance phone call. To reduce the 

m cost of this connection, telephone 218 may access PSTN 220, which in tum provides a 

synchronous connection to gateway 224 via Tl trunk 222. Because data in PSTN 220 is in 
Q 5 G.71 1 format, gateway 224 may translate the data into G.723 compressed format for 
hi transmission over asynchronous packet network 216, or gateway 224 may leave the data in 

S G.71 1 format and not change the compression format for transmission over packet network 

^ 216. Gateway 224 also provides the appropriate headers for routing the packets to gateway 

214. Gateway 214 may then decompress the reassembled packets, if necessary, from G.723 
20 format and translate the data into G.71 1 format for transmission to VRU 200 over Tl trunk 

212. As with the system in FIGURE 1, each specific connection made by VRU 200 generally 
requires a port and a 64 Kbps channel on Tl trunk 212. If the enhanced service being 
provided by VRU 200 requires connecting telephone 218 to another device external to VRU 
200, for example to telephone 206 or telephone 232, then intemal synchronous switch 238 
25 and another port and 64 Kbps channel are required to complete the connection. In addition, if 
the connection to the external device is back through gateway 214 and packet network 216, 
the entire sequence of compression/decompression, if necessary, and translation must be 
performed again. 
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SUMMARY OF THE INVENTION 
While a synchronous VRU connected to a gateway may take advantage of many of 
the benefits of a packet network over a switched network (e.g., lower cost long distance), this 
type of implementation is probably best applicable as an interim solution. For example, there 
5 may be some drawbacks associated with the implementation described above. First, packet 
networks, not switched networks, appear to be the dominant type of network for future 
communications, and thus the synchronous interface in a VRU may become less utilized. 

Second, even though a synchronous VRU may be connected to a packet network via a 
gateway, the VRU still generally requires an internal switch to connect one party to another 
flO for many enhanced services, such as calling card and one-number services. When the call 
~j media stream passes through the VRU, the application generally uses two ports to complete 

the connection, and the VRU ports stay engaged in the call for the duration of the call, 
ffl Typically, prior art VRUs switch synchronous data in G.71 1 format, which is the same format 

as used by the switches in the PSTN. Because of this, if data arrives in asynchronous G.71 1 
O 5 format, or G.723 format, the data must be converted to synchronous G.711 format so that the 
VRU can process it. 

G Third, the repeated conversions from one data format to another data format, such as 

fi-om G.71 1 to G.723, or from synchronous to asynchronous, may delay or degrade the data, 
and also use up processor resources which could be used for other functions more directly 
20 related to the core functionality of the VRU. 

Another difficulty with a synchronous VRU being connected to a packet network via 
a gateway is that this VRU is architecturally in the position of a gateway, which is a network 
"edge" device. These edge devices are generally expected to handle data translations and 
multiple device-type (e.g., voice, data modem and fax) access to the packet network. 
25 However, the digital signal processor ("DSP") power required for voice over Internet protocol 
("VoIP") compression, V.90 data modems, or fax modems, for example, is relatively high. In 
a VRU, this processing power would be better utiUzed performing enhanced services, such as 
voice recognition and DTMF detection, which are more directly related to the core 
functionality of the VRU. Alternatively, the data translation would be better placed in a 
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device which is intended to be a network edge device, such as a gateway, allowing the VRU 
to function with less processing power, and thus be more cost efficient. 

There are many enhanced services provided over the PSTN network that are just as 
applicable to and useful in a packet-based network. Generally, customers will still want the 
5 types of enhanced services provided by VRUs even if they are using a packet network instead 
of the POTS network, and even if the media contains voice, video, data, or a combination 
thereof, instead of voice only. 

These and other objects, features and technical advantages are generally achieved by 
systems and methods for a packet VRU, or other media control system also referred to herein 
go as a packet Enhanced Service Provider ("ESP"), which directly utilizes packet network 

protocols, such as those of the H.323 standard, the Session Initiation Protocol (SEP) standard, 
fU the Simple Gateway Control Protocol ("SGCP") standard, or the Media Gateway Controller 

03 Protocol ("MEGACO") standard, to provide enhanced services in a packet network. 

Although preferred embodiments of the present invention are described with reference to a 
H5 VRU providing media control according to the present invention, it should be appreciated 
yj that a system providing VRU functionality is not required according to the present invention. 

In Accordingly, any system or systems of the network having sufficient processing power, 

^ suitable interfacing, and an instruction set operating according to the present invention, may 

be utilized to provide the functionality described herein. For example, rather than a calling 
20 party initiating a call to a VRU to provide enhanced calling services as described herein, the 
calling party's own system, such as may be embodied in a processor based "smart" phone or 
personal computer system, may provide media control as described herein. Similarly, a 
called party's system may provide media control as described herein. 

Moreover, it should be appreciated that media control of the present invention need 
25 not be centrahzed in a single controlling system. Accordingly, a caUing party's system and a 
called party's system may cooperate to control media according to the present invention in 
order to provide enhanced calling services. For example, a calling party's system may 
operate to control media streams to establish a call between the calling party and a first called 
party. Thereafter, the first called party's system may operate to control media streams to 
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establish a call between the first called party and a second called party as well as between the 
calling party and the second called party. As such, the present invention provides cooperative 
call control or cooperative media applications which facilitate enhanced calling services. 

The media control system, e.g., a packet VRU, of the present invention may directly 
5 connect to the packet network as a network "core" device, or connect via another network 
core device, such as an H.323 gatekeeper. In contrast to a network edge device (e.g., a 
gateway), a network core device (e.g., a gatekeeper or a router) generally operates "within" 
the packet network and is not required to provide data format translation (e.g., synchronous to 
asynchronous) or multiple device-type access (e.g., fax and modem). Advantageously, the 
:flO media control system may be built entirely in software running on a network server with a 

standard packet network connection such as Ethernet or token-ring. The H.323, SIP, or other 
jij software protocol may contain all of the call placement, progress, and termination functions, 

ffl implemented as out-of^band signaling in a format similar to ISDN's Q.931 standard. 

' In a preferred embodiment of the present invention, a packet VRU may connect two 

H.5 or more parties together via the packet network, such as for an 800 calling card service or for 
W a teleconferencing service. Analogous to the discussion above with respect to the 

O synchronous VRU connected to the PSTN, it is desirable for the packet VRU to be able to 

connect two or more parties together and still maintain control of the call. This includes call 
administrative functions, tracking call context, processing input from users, etc. Therefore it 
20 is generally useful for a packet VRU to maintain control of the call and receive user input, 
signahng, or the audio stream, for example to detect user input indication (e.g., DTMF) 
messages, interpret voice input, or sum voices in a conference call. One way to accomplish 
this is for the packet VRU to receive and process the packets sent by a source, and then 
re-transmit the packet information to the proper destinations, 
25 However, there are generally three important sources of delay encountered when 

transmitting data across a packet network. First, there is a delay introduced if the data is 
compressed by the source. Generally, the source gateway must receive and store enough data 
in order for it to execute the compression algorithm. Depending on the specific algorithm 
used, compression can introduce, for example, 30 msec of delay into the signal. Second, 

844938.1 



47524-P104CP1-09908773 



13 



PATENT 



there may be a delay introduced by the source converting the data from non-packet form into 
packet form. Generally, the source gateway must receive and store a certain amoimt of data 
to fill a packet, and then generate a header to affix to the packet data. This packetization can 
introduce, for example, 50 msec of delay into the media transfer. Third, there may be a delay 
due to the inherent asynchronous nature of a packet network. Generally, packets arrive at a 
destination at varying times, and may even include overlapping and out-of-sequence packets. 
For the transferring of data files, this "jitter" generally does not introduce any significant 
problems because the data is not time critical. For real-time data, however, such as voice, 
video or multimedia data, a jitter buffer may be necessary to reconstruct the packets into a 
real-time message. The jitter buffer can introduce, for example, 100 msec of delay into the 
media stream because it must compensate for the jitter in the arrival of the packets. 

These compression, packetization and jitter delays may all be present in any transfer 
of data from a source to a destination in a packet network. If a packet VRU receives 
packetized data from a source and then re-transmits the packetized data to a destination, all 
three delays may be present in each separate media stream (i.e, from the source to the VRU, 
and from the VRU to the destination). Adding the second set of delays to the transfer may be 
unacceptable for real-time media communication. In addition, there may be excess delay 
associated with the transportation of the two (or more) separate media streams in the network, 
especially if the originating and terminating parties are located close to each other and the 
packet VRU is located far from the parties. Generally, this delay may be caused both by the 
increased distance that the signals must travel, and by all the extra routers and switches and 
other circuitry which the signals must pass through in the network. Users are very sensitive 
to delay, which can be distracting at the least, and may cause parties to start talking over one 
another if the delay becomes too excessive, significantly disrupting the conversation. Delay 
may even cause sufficient user dissatisfaction to push users to seek another service provider. 

Accordingly, it is highly desirable for the packet VRU to reduce or avoid these delays, 
while at the same time maintaining control of the call. In a preferred embodiment of the 
invention the packet VRU may utilize protocols available in the packet network to redirect a 
source's media stream from the packet VRU to another destination. In this way the media 
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stream is sent directly to the destination instead of passing through the packet VRU. 
Alternatively, if the packet VRU must perform processing on the message contents, the 
packets may be directed to the receiving parties, and in addition continue to be sent to the 
packet VRU, By redirecting the packets directly to the receiving parties, these embodiments 
generally avoid any additional compression, packetization and jitter delays that would be 
introduced by a second subsequent media stream from the VRU to the destination. 

In a preferred embodiment, the packet VRU generally redirects only the media 
streams themselves to be sent directly between the parties. The packet VRU may still retain 
call control over the media streams by maintaining the signaHng and user input components 
of the call. For example, the RTP/RTCP media streams may be redirected to be sent directly 
between the gateways, but the H.245 and Q.931 call structures between the gateways and the 
VRU may be kept intact. 

In H,323 VoIP architecture, the DTMF or other user signaling may be taken out-of- 
band from the RTP streams using H.245 Userlnputlndication messages, as described in more 
detail in section 7.12.6 of the H.245 specification. This feature was specified in the H.323v2 
specification because some voice compression schemes destroy in-band DTMF information. 
This feature was intended to allow out-of-band DTMF information to be sent to the same 
endpoint as the in-band voice information, but this feature may also be exploited to route the 
user input to a different endpoint than the RTP media stream. H.245 section 7.12.6 User 
Input also describes a method to provide DTMF duration information in the 
Userlnputlndication messages using Signal and SignalUpdate parameters. This feature may 
be used to transfer tone duration information out-of-band from the RTP streams. Tone 
duration is useful in many apphcations, such as calling card call re-origination. 

Thus in a further preferred embodiment of the present invention, a gateway or browser 
may convert user input indication signals (e.g., DTMF signals from a telephone, or keyboard 
input from an IP phone) received from a party connected via the gateway or browser mto user 
input indication messages in an out-of-band channel in the H.323 protocol to be read by the 
packet VRU, separate from the redirected media streams. This may be especially useful for 
higher compression schemes (e.g., G.723) which cannot accurately compress and decompress 
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user input indication signals in-band with the voice signal. By using user input indication 
messages, the packet VRU advantageously does not need to receive the media streams if the 
sole reason is to detect user input indication signals, and this approach also circumvents the 
digital signal processing associated with in-band user input indication detection. Thus the 
5 packet VRU may redirect the media streams to travel directly between the parties without 
passing through the packet VRU, and still maintain call control, including receiving user 
input indication messages from the users. Alternatively, if the receiving party also needs to 
receive user input indication signals, for example if the receiving party is a synchronous VRU 
monitoring user input indication signals, then either the originating gateway or the packet 

y 0 VRU can send the user input indication messages to the destination gateway, which may then 
convert the messages back into actual user input indication signals added into the voice 

ly signal. 

The H.323 and SIP protocols also provide for multiple media paths, such as may be 
utilized in providing stereo channels or for video and audio channels. Accordingly, if it is 
Q 5 desired to provide the DTMF or other user signaling in-band of the RTP streams while 
| y allowing flexibility for redirection of the signaling stream independent of another data stream, 

embodiments of the present invention may utilize multiple RTP streams to carry the 
H information. For example, a preferred embodiment of the present invention may estabUsh a 

first RTP stream associated with voice communication and a second RTP stream associated 
20 with in-band DTMF signaling. Thereafter, the first RTP stream may be redirected, such as to 
a called party, while the second RTP stream is unaltered. Of course, the second RTP stream 
may be redirected while the first RTP stream remains unaltered, either or both RTP streams 
may be replicated and the duplicate stream directed as desired, or the media streams 
otherwise directed as desired, according to the present invention. 
25 In an alternative embodiment, a VRU or media control system operating according to 

the present invention may solely utilize a voice-recognition user interface and therefore not 
require user input indication signals at all. Alternatively, if the user input indication signals 
are implemented in-band with the data channel, a user input indication detector in the packet 
VRU may be implemented, and for further functionality a user input indication generator may 
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also be implemented in the packet VRU. For these latter two embodiments, in addition to the 
media streams being transferred directly between the parties, the packet VRU would also 
need to receive copies of the media streams to process the data contained in them. One 
example of a standard for user input indication data transfer and reproduction is the "Voice 
5 over IP Interoperability Implementation Agreement," developed by the International 

Multimedia Teleconferencing Consortium ("IMTC"), located in San Ramon, CaHfomia and 
with a WWW site of "http://www.imtc.org." The specification, which supports two party 
voice and voice-band calls over IP networks, is based on H.323 standards and includes other 
telephony-specific requirements and IP specific needs such as directory services and dynamic 
30 IP address resolution mechanisms. 

, Accordingly, the present invention may be utilized to provide enhanced calling 

■ U services without introducing undesirable delays in the media stream while retaining control 

m over the call. Moreover, it should be appreciated that operation according to the present 

invention to provide enhanced caUing services does not require multiple input/output ports of 
HS the media controller to be dedicated for use in "trombonmg" a call as is often the case with 
hi prior art VRU call bridging sohitions. Additionally, as the present invention operates to 

g redirect the media streams between the endpoints of a call, issues with respect to indirect 

^ communication routing, e.g., transmission delays, long distance communication surcharges, 

etc., such as are often experienced with the use of an enhanced services node may be avoided 
20 or mitigated. 

In accordance with a preferred embodiment of the present invention, a method for 
redirecting media in an asynchronous packet network by a system asynchronously connected 
to the packet network comprises establishing a first call between a first device and the system 
via the packet network, wherein the first call comprises a first call control structure and a first 
25 media stream, and signaling the first device to redirect the first media stream to a second 
device, wherein the first call control structure is retained between the first device and the 
system. In a further aspect of this preferred embodiment, the method further comprises 
establishing a second call between the system and the second device via the packet network, 
wherein the second call comprises a second call control structure and a second media stream, 

844938.1 



47524-P 1 04CP 1 -09908773 



PATENT 



and signaling the second device to redirect the second media stream to the first device, 
wherein the second call control structure is retained between the system and the second 
device. 

In accordance with another preferred embodiment of the present invention, a 
5 computer program product having a computer readable medium with computer program logic 
recorded thereon for use in a system asynchronously connected to a packet network for 
redirecting media in the asynchronous packet network, comprises code for establishing a first 
call with a first device via the packet network, wherein the first call comprises a first call 
control structure and a first media stream, code for establishing a second call with a second 

"do device via the packet network, wherein the second call comprises a second call control 

structure and a second media stream, code for signaling the first device to redirect the first 

fU media stream to the second device, and code for signaling the second device to redirect the 

m second media stream to the first device, wherein the first and second call control structures 

^ are not redirected away from the system. 

tl5 In accordance with yet another preferred embodiment of the present invention, a 

y system for redirecting media in an asynchronous packet network comprises an asynchronous 

S interface to the packet network, means for establishing a first call with a first device via the 

^ packet network, wherein the first call comprises a first call control structure and a first media 

stream, means for establishing a second call with a second device via the packet network, 
20 wherein the second call comprises a second call control structure and a second media stream, 
means for signaling the first device to redirect the first media stream to the second device, 
and means for signaling the second device to redirect the second media stream to the first 
device, wherein the first and second call control structures are not redirected away fi-om the 
system. 

25 In accordance with still another preferred embodiment of the present invention, a 

system for redirecting media in an asynchronous packet network comprises an asynchronous 
interface to the packet network, a call control server, wherein the call control server sets up 
call control structures to communicate with devices in the packet network via the 
asynchronous interface for controlling media streams from and to the devices, a voice media 
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server coinmumcating with the call control server, wherein the call control server uses the 
call control structures to establish media streams between the devices and the voice media 
server via the asynchronous interface, and an application server commimicating with the call 
control server and the voice media server, wherein the application server instructs the call 
5 control server to redirect the media streams to be transmitted directly between the devices 
without passing through the system, and wherein the call control structures are retained 
between the devices and the system. 

In accordance with a preferred embodiment of the present invention, control for 
redirecting media in an asynchronous packet network is distributed throughout devices in the 
■fllO packet network. For example, in operation according to this preferred embodiment, media 
M redirection control may be distributed such that a first network device, such as a caller's 

f S terminal device, sets up call control structures to communicate with a second network device, 

and the second network device sets up call control structures to communicate with a third 
- network device. Preferably, the call control protocols are bilateral allowing the various 

ill 5 network devices to communicate with one another and to cooperate in providing the desired 
!2 calling services. 

Q Accordingly, it should be appreciated that an advantage of the present invention is 

that call control is not limited to a single controller device, and may in fact be distributed to a 
plurality of network devices, A further advantage of the present invention is that there is no 
20 requirement that the network itself operate to control a call, such as is the case with the 
switches of the PSTN, but instead nodes coupled to the network, whether one or more, 
operate to control the calls and provided enhanced caUing services. 

An advantage of a preferred embodiment of the present invention is that a media 
controller, such as provided by a packet VRU of the present invention, may generally provide 
25 the existing enhanced services of a synchronous VRU, but in a packet network environment. 
Another advantage of a preferred embodiment of the present invention is that a packet VRU 
may provide enhanced services for multimedia commimications in addition to voice-only 
communications. Because of the added multimedia functionality, a packet VRU may also be 
described as a packet Multimedia Response Unit ("MRU"), or a packet Interactive 
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Multimedia Response ("IMR") Unit. All such systems may also be referred to as the 
aforementioned packet Enhanced Service Provider ("ESP")- Of course, with the added 
multimedia functionality, nev^ enhanced services, such as video conferencing, shared 
whiteboarding and text chatting, v^hich were not implemented in voice-only communications, 
5 will become desirable, and all such enhanced services are intended to be within the scope of 
the present invention. 

A further advantage of a preferred embodiment of the present invention is that 
repeated conversions from one data format to another data format are avoided because the 
media is sent directly from source to destination, and not through a centralized media control 
y 0 system, such as a VRU. In addition, because the media control system of the present 
H invention is implemented as a core device within the packet network instead of as an edge 

fij device, the media control system does not need to provide multiple device-type access such 

as for modems and fax machines. Instead, gateways may direct only the voice calls to 
''^^ particular aspects of the media control system, such as a packet VRU, and direct fax and 

015 modem calls elsewhere. Also, the media control system may not need to provide data format 
!7| conversion between the packet network and another type of network, such as a switched 

y network, although connecting a combined packet/synchronous VRU to both types of 

networks may still be desirable for some applications. 

A further advantage of a preferred embodiment of the present invention is that a 
20 packet network interface generally does not require multiple physical ports and an intemal 

switch for connecting more than one party together for enhanced services such as calling card 
and one-number services. Instead, any switching/routing is handled in the packet network 
itself. A single packet network interface may handle all traffic with the media control system. 
For example, a single 100 Mbit Ethernet interface may carry over 10,000 5 Kbit G.723 
25 compressed voice channels plus overhead. Alternatively, more than one packet network 

interface may be implemented. In addition, multiple parties may be connected by redirecting 
the media streams to travel directly between the parties, without passing through the media 
control system. Thus the media control system may avoid the delays associated with an 
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internal jitter buffer, internal processing of the packets, and separate media streams from the 

media control system to each party. 

A further advantage of a preferred embodiment of the present invention is that a 

media control system of the present invention, such as a packet VRU, may redirect the media 
5 streams and still retain control of the call by keeping the call states between the parties and 

the media control system intact. Redirecting the media streams may free up valuable 

resources in the network devices, such as a packet VRU, such as voice recognition resources, 

so that they can be used to handle other calls. In addition, the media control system may still 
O receive user input indication messages. This embodiment has a further advantage over a 

JlO synchronous VRU in that it can perform a fimction similar to RLT in the PSTN, discussed 
J:^ above, but still monitor for user input indication signals and still keep track of the call 

111 context. Thus the media control system, and not the network, would monitor for user input 

G indication signals. For example, if a packet VRU redirects a calling card caller's call from a 

third party to the VRU in response to a user input indication message, the calling card caller 
H5 would not have to re-enter Card Nxrmber and PESF information to make a second calling card 
S call. 

Yet another advantage of a preferred embodiment of the present invention is that 
generally only the amount of bandwidth needed is used in the packet network interface (and 
throughout the packet network), instead of the 64 Kbps channels generally required for each 

20 connection in a switched network. 

The foregoing has outlined rather broadly the features and technical advantages of the 
present invention in order that the detailed description of the invention that follows may be 
better understood. Additional features and advantages of the invention will be described 
hereinafter which form the subject of the claims of the invention. It should be appreciated by 

25 those skilled in the art that the conception and specific embodiment disclosed may be readily 
utilized as a basis for modifying or designing other structures for carrying out the same 
purposes of the present invention. It should also be reahzed by those skilled in the art that 
such equivalent constructions do not depart from the spirit and scope of the invention as set 
forth in the appended claims. 
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BRIEF DESCRIPTION OF THE DRAWING 
For a more complete understanding of the present invention, and the advantages 
thereof, reference is now made to the following descriptions taken in conjunction with the 
accompanying drawing, in which: 
5 FIGURE 1 is a block diagram of a prior art synchronous VRU connected to a PSTN; 

FIGURE 2 is a block diagram of a synchronous VRU indirectly connected to a packet 
network via a gateway; 

FIGURE 3 is a block diagram of a packet VRU implemented on a packet network in 
which two users are connected to each other from gateway to gateway in a connection 
y 0 controlled by the VRU; 

FIGURES 4a-4d are a series of block diagrams illustrating a sequence for redirecting 
ly media within a packet network; 

FIGURE 5 is a flow diagram illustrating a message protocol for redirecting media 
using communication mode command procedures; 
Q5 FIGURE 6 is a flow diagram illustrating a message protocol for tearing down 

ly redirected media using communication mode command procedures; 

4 FIGURE 7 is a flow diagram illustrating a message protocol for redirecting media 

H using user input indication messages; 

FIGURE 8 is a flow diagram illustrating a message protocol for tearing down 
20 redirected media using user input indication messages; 

FIGURE 9 shows a block diagram illustrating a VRU implementing a whisper mode 
of operation according to the present invention; 

FIGURE 10 shows a block diagram illustrating a VRU implementing an advertising 
mode of operation according to the present invention; 
25 FIGURE 1 1 shows a block diagram illustrating a VRU implementing a call recording 

mode of operation according to the present invention; 

FIGURE 12 shows a block diagram illustrating a VRU implementing a call 
broadcasting mode of operation according to the present invention; 
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FIGURE 13 shows a block diagram illustrating a VRU implementing a one-number 
mode of operation according to the present invention; 

FIGURES 14a-14d show a series of block diagrams illustrating a VRU implementing 
an operator assistance mode of operation according to the present invention; and 

FIGURES 15 a- 15c shows a series of block diagrams illustrating cooperative call 
control to establish conferencing as accomplished using caller terminals. 
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DETAILED DESCRIPTION 
FIGURE 3, is a block diagram of a preferred embodiment of the present invention in 
which packet VRU 600 is connected to packet network 602 via asynchronous Ethernet 
interface 604. Packet VRU 600 is capable of using H.323 protocols or other packet network 
5 protocols to communicate with other devices in packet network 602. In this embodiment, 
packet VRU 600 communicates directly with gateway 606, via the packet network side, to 
allow connection of multiple devices that are external to packet VRU 600. By 
communicating with gateway 606, packet VRU 600 can effectively perform those enhanced 
services which require switching (e.g., 800 calling card service and one number service) in 
^^0 the synchronous VRUs illustrated in FIGURES 1 and 2, but without requiring an internal 
'^^ hardware switching mechanism. 

fU Packet VRU 600 includes data processor 620 and memory 622. Data processor 620 

may be a processor board containing one or more general purpose processors, DSPs, or 
"'"^ custom processors. Memory 622 may be any type of typical storage device used in 

Q 5 compxiters such as a magnetic or optical disks, non-volatile or volatile RAM or magnetic 
= tape. Data processor 620 provides control and interactive communication with users and 

y handles user requests, while memory 622 provides storage for outgoing messages or message 

H components and for recording user input. 

Similar to the network discussed above with respect to FIGURE 2, gateway 606 is 
20 connected to packet network 602 via a packet-based interface. Gateway 606 provides a 
network bridge between packet network 602 and PSTN 608, and thus to the devices 
connected to PSTN 608, such as telephone 618, data modem 610 and fax machine 612. Other 
devices which may connect to packet network 602 include multimedia personal computer 
("PC") 614 and gatekeeper 616, both of which are capable of using H.323 protocols to 
25 communicate with other devices in packet network 602. 

In order for telephone 618 to connect to VRU 600, telephone 618 must first connect to 
originating gateway 606 via PSTN 608, generally using a G.71 1 data format. Gateway 606 
may optionally transcode the G.71 1 format into a higher compression/lower data rate format, 
such as G.723 format. Gateway 606 then packetizes the data and attaches the appropriate 
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headers to the packets for transmission to packet VRU 600 across packet network 602. 
Because packet VRU 600 is connected to packet network 602 as a network core device, 
packet VRU 600 generally does not need to provide multiple device-type (e.g., voice, fax and 
data modem) access to the packet network. These functions are performed by gateway 606 as 
a network edge device in linking PSTN 608 to packet network 602; gateway 606 generally 
routes only voice calls to packet VRU 600. 

An H.323 call using Q.931 signaling and H.245 call control is set up between gateway 
606 and packet VRU 600 via packet network 602. Packet VRU may then set up an 
RTP/RTCP media stream between packet VRU 600 and gateway 606. Generally only media 
data is transmitted over the media stream, not call control or user input indication signals. To 
connect telephone 618 to another party, such as telephone 630, packet VRU 600 sends control 
signals to gateway 606 to redirect the media stream to another device linked to packet 
network 602, such as destination gateway 626. This preferred embodiment is somewhat 
similar to RLT in a switched network, but with the important difference that packet VRU 600 
can still maintain control of the call because packet VRU 600 does not redirect the call 
control signals. Advantageously, the extra set of delays associated with the packets first 
being received and processed by packet VRU 600 and then transmitted to gateway 626 are 
generally eliminated. In addition, the processing requirements for packet VRU 600 are 
generally reduced because all routing and data handling can be performed by gateway 606. If 
packet VRU 600 does not need to process the content of the data stream, it can request that 
gateway 606 only send the packets across packet network 602 to telephone 630 via gateway 
626. Alternatively, packet VRU 600 may request that gateway 606 replicate the data packets 
and send them to packet VRU 600 for processing, in addition to forwarding the data on to 
telephone 630. Call control and a return media stream from gateway 626 to gateway 606 may 
be set up in a manner similar to that described above for gateway 606. 

FIGURES 4a-4d illustrate a sequence for redirecting media on a packet network in 
accordance with another preferred embodiment of the present invention. FIGURES 4a-4d 
illustrate how to connect a caller to a called party using an 800 calling card enhanced service 
as an example appHcation. Of course, the inventive concepts are appUcable to any enhanced 
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service in which a packet VRU connects a party to one or more other parties via a packet 
network. In general, the calhng party may be a person, such as a customer, or may be a 
robotic resource, such as another packet VRU, The other party may be another person, such 
as another customer or an agent, or may be a robotic resource, such as an automated agent, or 
5 another VRU. Some of the details shown in FIGURE 3, such as fax machines and modems, 
are omitted from FIGURES 4a-4d for clarity, but the discussions with respect to FIGURE 3 
are still applicable to the embodiment illustrated in FIGURES 4a-4d. 

With reference to FIGURE 4a, there is shown VRU 800 asynchronously connected to 

O IP network 806, for example via an Ethernet connection. VRU 800 includes call control 

^|0 server ("CCS") 802, voice media server(s) ("VMS") 804, and application server 803. An 

NSP-5000, available from InterVoice, Inc., 178 11 Waterview Parkway, Dallas, Texas, 75252, 

Oj with Calling Card and VoIP capability may be used to implement VRU 800, Domain 

gatekeeper 808 is also connected to IP network 806, and maintains a directory of IP addresses 
for the various devices in the network. Also present on the network are gateways with VoIP 
capability, such as originating gateway 810 and terminating gateway 812 (also referred to 

O herein as destination gateway). 

2 In this preferred embodiment the VRU provides an 800 caUing card service. In a 

standard 800 calhng card service, a caller dials the 800 service access number for the VRU. 
The VRU carries on an interactive dialog with the caller in order to obtain the caller's Card 
20 Number, PIN and the PSTN phone number for a desired party with whom the caller wishes to 
communicate. The VRU verifies the PIN and attempts to connect the caller to the desired 
party. The 800 calling card service may be a prepaid or postpaid service. In either case, the 
VRU generally needs to monitor the duration of the phone call in order to charge the caller 
the correct amount of money for the phone call. If a preset or predetermined limit is in effect, 
25 (i.e., either the amount of money on a prepaid calling card, or a ceiling on the amount of 

credit allowed for a postpaid card), then the VRU also needs to monitor and have control over 
the phone call so that the call can be terminated if the limit is reached or exceeded. 

In FIGURE 4a, a caller using POTS telephone 814 dials the 800 service access 
number. The PSTN network routes the call 816 to originating gateway 810. Preferably, 
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originating gateway is physically located close to the caller, so that minimal cost is incurred 
in the PSTN network. The service provider for the 800 calling service may have gateways 
located throughout a country, for example in the major cities in the United States. In a 
preferred embodiment, the original 800 call is routed to the closest gateway in the PSTN. 
5 Alternatively, the original 800 call is always routed to a specific gateway, irrespective of the 
location of the caller. Originating gateway 810 receives the call from the PSTN, and queries 
818 domain gatekeeper 808 via IP network 806 for the PSTN-number-to-IP address 
translation, which is sent back 818 to gateway 810 by gatekeeper 808. 
_ Originating gateway 810 then estabUshes H,323 call 820 to CCS 802 in VRU 800. 

=ilO Q.931 call signaling identifies the source and destination and establishes a virtual signal 
%j connection between gateway 810 and VRU 800. The signaHng connection is established 

i;™ when the H.323 Stack signals that the call is in the connected state. Then the H.245 call 

m control process exchanges capabilities between gateway 810 and VRU 800, and is complete 

when gateway 810 and VRU 800 have estabhshed inbound and outbound logical channels 
?=il5 between each other. Once the inbound and outboimd logical channels (User Datagram 
i: Protocol ("UDP") addresses) are known, an RTP/RTCP session can be estabhshed for 

□ transferring media streams between gateway 810 and VRU 800. 

CCS 802 determines caller ID and called number information from the H.245-Q.931 
data. CCS 802 uses the caller ID and called number information to determine the type of 
20 service (application) to be apphed to the incoming call, in this case 800 calling card service, 
by application server 803, which initiates the appropriate application. CCS 802 also selects 
the port in VMS 804 to be used to handle the call, and sends the card application context data 
822 to VMS 804. CCS 802 directs originating gateway 810 to send its RTP stream to a 
media port on VMS 804. Similarly, VMS 804 is directed by CCS 802 to send its RTP stream 
25 to originating gateway 810, thus estabhshing a ftiU duplex audio connection 824 between 
originating gateway 810 and VMS 804, As discussed hereinabove, gateway 810 is an edge 
device, and provides for translation between synchronous PSTN and asynchronous IP 
network 806, 

844938.1 



47524-P 1 04CP 1-09908773 



PATENT 



Application server 803 may then command VMS 804 to execute an interactive voice 
script v/ith the caller to provide voice greetings and menus. The script obtains the caller's 
Card Number, PIN and the PSTN phone number that the caller wishes to reach, in this case 
the phone number for POTS phone 832. POTS phone 832 is connected to IP network 806 via 
5 the PSTN and gateway 812. Application server 803 validates the Card Number and PIN in its 
customer card database. 

Turning now to FIGURE 4b, apphcation server 803 directs CCS 802 to place a 
separate, secondary call to POTS telephone 832, which has the PSTN number specified by 
the caller. To accomphsh this, CCS 802 first queries 826 gatekeeper 808 to find the IP 
MO address of the appropriate gateway to reach the called PSTN number, in this case terminating 
'^q gateway 812. Gatekeeper 808 returns 826 the IP address of gateway 812 to CCS 802. CCS 

J=^ 802 then places a second H.323 call 828 to terminating gateway 812 by using the IP address 

provided by gatekeeper 808. When terminating gateway 812 responds to H.323 call 828, 
CCS 802 directs terminating gateway 812 to send its RTP stream to an IP address on VMS 
'yX 5 804. Similarly, VMS 804 is directed to send its RTP stream to terminating gateway 812, thus 
!S estabUshing a second full duplex audio connection 830 (two opposite direction RTP sessions) 

D between terminating gateway 812 and VMS 804. 

Finally, to reach the desired party, CCS 802 instructs terminating gateway 812 to 
extend H.323 call 828 into the PSTN using the POTS number provided by the caller. 
20 Terminating gateway 812 complies by placing PSTN call 834 to the called party on POTS 
phone 832. Apphcation server 803 monitors the call progress, and when answer occurs, 
apphcation server 803 instructs VMS 804 to execute an interactive voice script with the 
called party. The script may provide voice greetings with screening and identification of the 
called party. At this point there are two separate connections established via IP network 806, 
25 fi-om POTS phone 814 to VRU 800, and fi-om VRU 800 to POTS phone 832. 

Turning now to FIGURE 4c, there is illustrated a preferred embodiment of the 
invention, in which media sent to VRU 800 is redirected to travel directly between the 
originating gateway 810 and terminating gateway 812, thus bypassing VRU 800. Once the 
called party is vahdated, application server 803 instructs CCS 802 to redirect the media 
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streams. CCS 802 requests that originating gateway 810 and terminating gateway 812 send 
their respective RTP streams directly to each other, instead of to VMS 804. CCS 802 
accomplishes this by tearing down RTP session 824 between originating gateway 810 and 
VMS 804, and by tearing down RTP session 830 between terminating gateway 812 and VMS 
5 804. Only RTP sessions 824 and 830 are torn down; H.323 call 820 between originating 

gateway 810 and VMS 804, and H,323 call 828 between terminating gateway 812 and VMS 
804, are left connected. 

To establish communications directly between the gateways, CCS 802 requests that 
originating gateway 810 redirects its RTP stream 836 to terminating gateway's 812 media 

aO port. Likewise, CCS 802 requests that terminating gateway 812 redirect its RTP stream 838 
to originating gateway's 810 media port. Again, the H.323 call states are not modified, only 

IS the RTP streams are moved. Thus CCS 802 may still monitor out-of^band user input 

indication signaling on the originating leg of H.323 call 820 from the calling party via 
originating gateway 810. VRU 800 may still monitor and control the communication 

ii 5 between the calling and called parties via H.323 calls 820 and 828, but data sent between the 
calling and called parties travels via RTP streams 836 and 838 and no longer needs to pass 

C3 through VRU 800. Alternatively, for some enhanced services, VRU 800 may still need to 

monitor the contents of the call between the calling and called parties. In that case, VRU 800 
may not tear down the original RTP streams and instead simply establish the new RTP 
20 streams, which are copies of the original RTP streams. Once the call is terminated, either by 
one of the parties or by the VRU, appHcation server 803 instructs CCS 802 to tear down RTP 
streams 836 and 838, and H.323 calls 820 and 830. VRU 800 may also complete any 
administrative tasks, such as statistical recording or billing calculation and recording. 

Alternatively, a similar approach may be used to establish connections between more 
25 than two parties external to VRU 800, for example to provide a conferencing appUcation, 
VRU 800 sets up multiple H.323 calls and associated RTP media streams to each party 
participating in the conference, and then redirects the media streams to be transmitted from 
each party to every other party. The primary difference from the method discussed above 
with respect to FIGURES 4a-4c is that the media stream from each party is redirected to be 
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transmitted to more than one destination. In one alternative embodiment, the participants or 
the equipment in their paths, such as their respective gateways, have the abihty to perform the 
summation of the incoming signals themselves, and VRU 800 is not required to receive the 
media streams. In another alternative embodiment, the participants do not perform the 
5 summation of the incoming media streams, so VRU 800 receives each of the media streams, 
performs the summation of the signals, and sends the media streams out to each of the 
participants. In either case, and as discussed above, VRU 800 retains control of the call by 
leaving the H.323 calls intact. Also as discussed above, VRU 800 may still monitor for user 
input indication messages transmitted via the H.323 calls. 
0 Turning to FIGURE 4d, in another preferred embodiment, a caller may wish to place 

%J another phone call after completing a prior phone call without repeating the entire procedure 

of dialing the 800 number and entering in the Card Number and PIN. The only new 

Jfi information required from the caller to perform the re-origination function is the new 

destination telephone number. To make a new call, caller holds down the poimd key on 

yi5 POTS telephone 814 for longer than 2 seconds. Originating gateway 810 relays this signal to 

S CCS 802 via out-of^band user input indication signaling on H.323 call 820. Upon receiving 

indication that the caller desires to make another telephone call, application server 803 
instructs CCS 802 to tear down H.323 call 828 to terminating gateway 8 12 and RTP streams 
836 and 838. Originating gateway 810 may use the key-on key-off Userlnputlndication 
20 messages for user input indication carriage in accordance with H.245v3. Only originating 
H.323 call 820 is left active. 

To make the new phone call, application server 803 instructs CCS 802 to re-establish 
a fiiU-duplex RTP session with a media port on VMS 804, as discussed with respect to RTP 
stream 824 in FIGURE 4a. Also similar to the discussion with respect to FIGURE 4a, 
25 application server instructs VMS 804 to execute an interactive voice script with the caller. 
The script provides voice greetings and menus. Since the service application has already 
validated the caller, the script only needs to obtain the next PSTN phone number that the 
caller wishes to reach. Once the new phone number is obtained, the process is repeated again 
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as discussed with respect to FIGURES 4b-4c, If the caller hangs up, all H.323 calls are torn 

down and caller context is discarded. 

Generally, there are many ways to redirect a media stream in a packet network 

without affecting call control, and all such systems and methods are intended to be within the 

5 scope of the present invention. Media redirection may be implemented using custom 

functionality in the packet network, or it may be implemented in compliance with a defined 

methodology, such as by using functionality described in the H.323 specification. 

Some of these systems and methods have been tested in the laboratory for viability. 

The laboratory setup comprised a VRU system including an InterVoice ISA VCD card, a 

glO Natural MicroSystems C'NMS") Ag4000 card, an NMS Tx3210 card, NMS Fusion 3.0 

J1 software, and application software implementing the media redirect functions described 

K herein. The laboratory setup also comprised two gateway systems, each including an NMS 

m Ag8 card, an NMS T1/RT2 card, an NMS Tx2000 card, NMS Fusion 2,0 software, and a 

sample application software implementing the gateway functions described herein. The NMS 

^15 products are available from Natural MicroSystems, 100 Crossing Boulevard, Framingham, 

W Massachusetts, 01702-5406. The Fusion H.323 Stack Programmer's Guide and Reference, 

2 NMS P/N 6448-12, incorporated herein by reference, provides more detailed information 

"""" about the NMS Fusion software. 

H.323 section 8.3.5, entitled "Communication Mode Command Procedures" describes 

20 functionality that may be used to implement the present invention: 

The CommunicationModeCommand can be used to instruct 
endpoints in a conference (or a point-to-point call) to change modes by 
indicating a new mode for a mediaChannel that is already in use. It can also be 
used to tell an endpoint to transmit the media stream to a new address by 
25 indicating the mode currently in use, but with new mediaChannel. Similarly, 

an endpoint that receives a CommunicationModeCommand indicating the 
mode currently in use and no mediaChannel should close the appropriate 
channel and the attempt to reopen using the 

OpenLogicalChannel-OpenLogicalChannelAck sequence, where the 
30 OpenLogicalChannelAck contains the address to which the endpoint will send 

the media. 
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In accordance with a preferred embodiment of the present invention, FIGURE 5 
illustrates a message protocol 900 for redirecting media using the Communication Mode 
Command Procedures. This approach generally uses the communication mode of 
multicasting and the decentralized conference characteristics described in the H.323 standard. 
5 In order to implement media redirection in this manner, the participating gateways generally 
should support the Conference mode described in section 8.3.5 of the H.323 specification. 
The VRU generally should be identified as a Multipoint Controller ("MC") entity under the 
H.323 standard. In addition, to initiate the Conference mode, a VRU generally should be the 
:r-^ master terminal endpoint on the call, so the gateway routing calls to the VRU generally 

jHO should be configured to allow slave status. Preferably, the conferences generally should be of 
\l the same data type (e.g., G.71 1) and have the same data rate (e.g., 64 Kbytes/sec), 

m Alternatively, the media streams may have different data types or data rates, as long as the 

Irl receiving gateway is capable of decoding the data transmitted to it. 

Assume that there are two separate calls, A & B, already in the connected state 
W 5 between a first gateway 902 and VRU 901 , and between VRU 901 and a second gateway 903, 

as discussed hereinabove. The application issues request 904 to connect A and B in media 
;^ redirect mode. VRU 901, functioning as an MC, sends Multipoint Conference Indication 906 

to gateway 902 for call A, putting A into conference mode. Likewise, VRU 901 sends 
Multipoint Conference Indication 907 to gateway 903 for call B, putting B into conference 
20 mode. 

VRU 901 then executes the steps to redirect A's RTP media stream. VRU 901 sends 
Communication Mode Command 908 to instruct gateway 902 about a new multicasting 
address for Call A. In response, gateway 902 closes the current (previously opened) outgoing 
logical channel for Call A with VRU 901, and issues the CloseLogicalChannel message 909 
25 to VRU 90 L VRU 901 acknowledges the closing of the current outgoing channel for Call A 
by sending the CloseLogicalChannelAck message 910 to gateway 902. Then gateway 902 
opens a new outgoing channel for Call A and issues OpenLogicalChannel message 91 1 to 
VRU 901. VRU 901 acknowledges the opening of the new logical channel for Call A with 
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gateway 902 and sends OpenLogicalChaimelAck message 912, which contains call B's IP 
and RTP address, to gateway 902, thus redirecting Call A's media stream to gateway 903. 

This sequence is repeated for Call B with gateway 903 in order to redirect Call B's 
media stream. VRU 901 sends Communication Mode Command 913 to instruct gateway 903 
5 about a new multicasting address for Call B. In response, gateway 903 closes the ciment 
(previously opened) outgoing logical channel for Call B with VRU 901, and issues the 
CloseLogicalChannel message 914 to VRU 901. VRU 901 acknowledges the closing of the 
current outgoing chartnel for Call B by sending the CloseLogicalChannelAck message 915 to 
gateway 903. Then gateway 903 opens a new outgoing channel for Call B and issues 
: :do OpenLogicalChannel message 916 to VRU 901. VRU 901 acknowledges the opening of the 
'""4 new logical channel for Call B with gateway 903 and sends OpenLogicalChannelAck 

IIJ message 917, which contains call A's IP and RTP address, to gateway 903, thus redirecting 

fq Call B's media stream to gateway 902. Upon completion of the media redirection, a media 

redirect done message 918 is sent to the application indicating that the media redirect is 
Q5 complete. 

I y Once the call is completed, or for another reason, the application may issue request 

924 that the redirected media streams be tom down. After tearing down the RTP streams, 
^ VRU 921 may either command gateways 922 and 923 to tear down the call controls, or VRU 

921 may command gateways 922 and 923 to set up new RTP sessions with VRU 921, similar 
20 to the structure that existed before the media redirection. To illustrate the latter option, and 
with reference to message protocol 920 in FIGURE 6, assume that the media redirection 
illustrated in FIGURE 5 has already taken place, and that the media streams are set up 
directly between gateway 922 and gateway 923 for Calls A and B. 

VRU 921 first executes the steps to tear down Call A's redirected RTP media stream. 
25 VRU 921 sends Communication Mode Command 925 to instruct gateway 922 about a new 
multicasting address for Call A. In response, gateway 922 closes the current (previously 
directed to gateway 923) outgoing logical channel for Call A, and issues the 
CloseLogicalChannel message 926 to VRU 921. VRU 921 acknowledges the closing of the 
current outgoing channel for Call A by sending the CloseLogicalChannelAck message 927 to 
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gateway 922. Then gateway 922 opens a new outgoing channel for Call A and issues 
OpenLogicalChannel message 928 to VRU 921. VRU 921 acknowledges the opening of the 
new logical channel for Call A with gateway 922 and sends OpenLogicalChannelAck 
message 929, which contains the IP and RTP address of VRU 921, to gateway 922, thus 
5 redirecting Call A's media stream to VRU 921, VRU 921 sends End Multipoint Conference 
message 930 to gateway 922 to end the conference mode with Call A reverting to a connected 
state with VRU 921, 

This sequence is repeated for Call B with gateway 923 in order to tear down Call B*s 
redirected RTP media stream. VRU 921 sends Communication Mode Command 931 to 
JSlO instruct gateway 923 about a new multicasting address for Call B. In response, gateway 923 
closes the current (previously directed to gateway 922) outgoing logical channel for Call B, 
lU and issues the CloseLogicalChannel message 932 to VRU 921. VRU 921 acknowledges the 

m closing of the current outgoing channel for Call B by sending the CloseLogicalChamielAck 

" message 933 to gateway 923. Then gateway 923 opens a new outgoing channel for Call B 

Ol5 and issues OpenLogicalChannel message 934 to VRU 921. VRU 921 acknowledges the 
y opening of the new logical channel for Call B with gateway 923 and sends 

S OpenLogicalChannelAck message 935, which contains the IP and RTP address of VRU 921, 

^ to gateway 923, thus redirecting Call B's media stream to VRU 921 , VRU 921 sends End 

Multipoint Conference message 936 to gateway 923 to end the conference mode with Call B 
20 reverting to a connected state with VRU 921 . Upon completion of the media redirection tear 
down, a media redirect disconnect done message 937 is sent to the application indicating that 
the media redirect tear down is complete. 

In these preferred embodiments, all message protocols generally are already available 
in the H.323 specification, so custom modifications to the gateways are not required, 
25 although the gateways generally should be compliant with the relevant sections in the H,323 
specification. Upon completion of the call, the redirected media streams may be torn down in 
accordance with the H.323 specification. 

Other embodiments may require some custom functionality to be implemented in the 
gateways for redirection of the media streams. In accordance with another preferred 
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embodiment of the present invention, FIGURE 7 illustrates a message protocol for redirecting 
media using Userlnputlndication messages, and FIGURE 8 illustrates an associated message 
protocol for tearing down the redirected media streams using Userlnputlndication messages. 
To implement this embodiment, the gateways generally must be programmed to respond to 
5 special Userlnputlndication messages from the VRU. Because the RTP protocol generally is 
carried over the UDP, and is not associated with the H.245 call context, and because the 
gateway software does not use the IP address of the call for the RTP media stream, the system 
can specify different IP addresses and UDP ports to separate the RTP streams from the call 
control. The VRU may instruct the gateways to keep the dynamic UDP ports vahd by using 
J|) Userlnputlndication messages. In addition, the VRU may send a Userlnputlndication 
.Jt message to bring back the redirected media streams to have the RTP session established as 
^ y before the media redirection. 

m In this embodiment, the message protocol comprises the following: 

<Media Redirect Attention> <Media Redirect Command> <,> <DstIpAddress> <,> 
<DstRtpUdpAddress> <,> <DstRtcpUdpAddress> <,> <SrcIpAddress> <,> 
1^ <SrcRtpUdpAddress> <,> <SrcRtcpUdpAddress> <,> <RtpSessionMode> 

O All values are in the ASCII Hex representations. The Media Redirect Attention 

1=::^ Command is generally referred to as a ''bang," and is defined as 

<Media Redirect Attention> 

20 The Media Redirect Attention message signals to the gateway that a Media Redirect 

Command is following. The gateway then interprets the subsequent information as part of 

the media redirect protocol instead of as some type of DTMF message. There are two 

primary Media Redirect Commands: DROP_RTP and NEW_RTP, wherein: 

<Media Redirect Command> = "9" for DROP RTP Command 

25 <Media Redirect Command> = "5" for NEW_RTP Command 

Referring to message protocol 940 in FIGURE 7, assume that there are two separate 

calls, A & B, already set up between a first gateway 946 and the VRU, and between the VRU 

and a second gateway 948, as discussed hereinabove. VRU application 942 initiates media 

redirection by issuing media redirect command 950 to VoIP driver 944 inside the VRU. 

30 VoIP driver 944 then handles the detailed protocol of sending Media Redirect Messages to 
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the gateways to accomplish the media redirection. First VoIP driver 944 sends DROP_RTP 
A Message 952 to gateway 946 to command gateway 946 to drop the media stream between 
gateway 946 and the VRU. Similarly, VoIP driver 944 sends DROP_RTP B Message 954 to 
gateway 948 to command gateway 948 to drop the media stream between gateway 948 and 
5 the VRU. VoIP driver 944 then sends NEW_RTP A-to-B Message 956 to gateway 946 to 
establish the new media stream from gateway 946 to gateway 948. Similarly, VoIP driver 
944 then sends NEW_RTP B-to-A Message 958 to gateway 948 to estabUsh the new media 
stream from gateway 948 to gateway 946. Finally, VoIP driver 944 sends media redirect 
complete message 959 back to VRU application 942 to indicate completion of the media 
11) redirection. As previously discussed, only the media streams are redirected, and the H.245- 
M G.93 1 call control structures between the VRU and each gateway are left intact. 
r^~:j Once the call is complete, or for another reason, the VRU may command the gateways 

^ to tear down the redirected media streams. After the media streams are torn down, the VRU 
H may either command the gateways to tear down the call controls, or the VRU may command 
:W the gateways to set up new RTP sessions with the VRU, similar to the structure that existed 

before the media redirection. To illustrate the latter option, and with reference to message 
Q protocol 960 in FIGURE 8, assume that the media redirection illustrated in FIGURE 7 has 
M= already taken place, and that the media streams are set up directly between gateway 966 and 

gateway 968. VRU application 962 initiates media redirection tear down by issuing media 
20 redirect tear down command 970 to VoEP driver 964 inside the VRU. VoEP driver 964 then 
handles the detailed protocol of sending Media Redirect Messages to the gateways to 
accomplish the media redirection tear down. First VoEP driver 964 sends DROP RTP 
A-to-B Message 972 to gateway 966 to conmiand gateway 966 to drop the media stream from 
gateway 966 to gateway 968. Similarly, VoIP driver 964 sends DROP_RTP B-to-A Message 
25 974 to gateway 968 to command gateway 968 to drop the media stream from gateway 968 to 
gateway 966. VoIP driver 964 then sends NEW_RTP A-to-VRU Message 976 to gateway 
966 to reestablish the media stream from gateway 966 to the VRU. Similarly, VoIP driver 
964 then sends NEW RTP B-to-VRU Message 978 to gateway 968 to reestabhsh the media 
stream from gateway 968 to the VRU. Finally, VoIP driver 964 sends media redirect 
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complete message 980 back to VRU application 962 to indicate completion of the media 
redirection tear down. As previously discussed, only the media streams are reestablished 
between the VRU and the gateways, and the H.245-G.931 call control structures between the 
VRU and each gateway continue to remain as they were originally set up, 
5 Another specific media redirection implementation may be to use functions (e.g., 

CallJoin and Calllnvite) described in section 8,4,3 of the H.323 specification, entitled Ad-hoc 
conference expansion. While preliminary laboratory tests thus far have not allowed the 
exchange of voice data between call A and call B in the laboratory, a conference in between 
call A and call B has successfully been established. Therefore the Ad-hoc conference 

M expansion functions may also represent a viable approach for media redirection. 

^ Depending on the specific application, a packet VRU according to the present 

invention may provide many different enhanced services to users linked to the network, 

ffl including voice messaging, email (containing at least one of voice, audio and data), 

automated collect calling, intemational callback, prepaid calling card, postpaid calling card, 
store & forward, one number, find me, follow me, 800/900 service, automated customer 
service, automated agents or attendants, enhanced fax, voice activated dialing, prepaid & 

O postpaid wireless, conferencing, and other enhanced services. These services may be voice 
services, similar to the services provided by synchronous VRUs, or may be multimedia 
services, capable of handling any combination of voice, video and data (e.g., text). 

20 FIGURES 9-15 illustrate redirection of media on a packet network in accordance with 

preferred embodiments of the present invention to provide specific applications as mentioned 
above. The illustrated applications are exemplary of the operation of the present invention 
and are not intended to limit the applicability of the present invention. It should be 
understood that media redirection according to the present invention utilizes network devices 

25 adapted to provide media stream handling functionality, such as to controUedly transmit 
media streams, replicate multiple copies of media streams, and/or manage received media 
streams, including a plurality of media streams, to provide any number of enhanced calling 
functions. Accordingly, using such functionality cooperative media applications of the 
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present invention may operate in a number of configurations, only a select few of which are 
expressly described herein below, to provide enhanced calling services. 

Directing attention to FIGURE 9 operation of a preferred embodiment of the present 
invention to provide "whisper" mode messaging is illustrated. In the embodiment of 
5 FIGURE 9 a full duplex call has been established between telephones 814 and 832. This call 
may be established as described above. For example, a caller using POTS telephone 814 may 
dial a toll free service access number to thereby be coupled to VRU 800, such as via a full or 
half duplex audio connection (such as media link 824 shown in FIGURE 4a) and/or a 
signaling connection, such as signaling connection 995. VRU 800 may then execute an 
interactive voice script with the caller to provide voice greetings and/or menus and thereby 
J1 acquire/provide information, such as information with respect to a method of payment for a 
ry call and/or a desired called party. Thereafter, VRU 800 may place a separate, secondary call 
02 to POTS telephone 832 to thereby couple VRU 800 to telephone 832, such as via a full or 
half duplex audio connection (such as media link 828 shown in FIGURE 4b) and/or a 
signaling connection, such as signaling connection 996. Finally, to place telephone 814 in 
hi communication with telephone 832, the data stream sent to VRU 800 is preferably redirected 
in to travel directly between the originating gateway 810 and terminating gateway 812 (data 
^ streams 991 and 992), thus bypassing VRU 800. 

In the embodiment of FIGURE 9, messaging in addition to that provided between 
20 telephone 814 and telephone 832 and that of signaling connections 995 and 996 is desired. 
For example, where VRU 800 is providing a prepaid caUing service, it may be desirable to 
provide messages to the calling party through telephone 814 with respect to the status of the 
prepaid calling account utilized for the call. However, it may be undesirable to provide these 
messages to the called party through telephone 832, For example, the VRU may want to 
25 whisper in the calling party's ear that his calling card is about to expire and that the caller 
needs charge another amount, e.g., $20, on a credit card to continue the present call. 

Accordingly, VRU 800 opens up another data stream to telephone 814, shown as data 
stream 993. At this point telephone 814 is receiving two data streams, one from the called 
party at telephone 832 and another from VRU 800. However, the called party at telephone 
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814 continues to receive only one data stream, that from telephone 814. Accordingly, the 
embodiment of FIGURE 9 provides a special case of a conference where various participants 
are conmiunicating with different numbers of the total participants. 

The caller at telephone 814, in addition to his conversation with the called party at 
5 telephone 832, hears a voice or other signal from VRU 800 providing information, such as 

call status information. This message may be informational such as to state that "y^vir calling 
card balance will be depleted in five minutes." Additionally or alternatively this message 
may solicit a response such as to request that the caller "please press *23 if you want to 
charge your credit card another 20 dollars, otherwise your call will be terminated in another 
ft 30 seconds." 

"4 It should be appreciated that, as described above, preferred embodiments of the 

ni present invention utilize a signaling channel separated from the data stream which remains 

established between the calling party, such as at telephone 814, and a service provider 
"J system, such as VRU 800, Accordingly, responses to the whisper mode messages, such as 
H the DTMF key sequence *23 to indicate authorization for credit card charges, may also be 
;n held private from other parties, such as the called party at telephone 832. Of course, such 
;5 signals may be passed on to other parties by the service provider, such as through signaling 
M= channel 996. For example, VRU 800 may filter off particular key sequences utilized in 

providing communications, such as the aforementioned *23, while passing remaining key 
20 sequences through to a called party. 

The whisper mode conferencing of FIGURE 9 is facilitated through the use of 
network systems having good echo canceling. Specifically, if gateway 810 were to provide 
very poor echo cancellation, the called party at telephone 832 may hear the message 
transmitted from VRU 800 to telephone 814. Of course, even somewhat poor echo 
25 cancellation may be mitigated through the use of techniques such as reducing the amplitude 
(volume) of the signal originally transmitted to telephone 814 and/or transmitting a canceling 
(e.g., out of phase) or concealing (e.g., increased noise floor) signal from VRU 800 to 
telephone 832. 
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It should be appreciated that in order to provide the combined data streams of 
telephone 832 and VRU 800 to telephone 814, gateway 810 may be adapted to provide signal 
summing to thereby provide a combined voice stream to a single speaker of telephone 814. 
Of course, such signal summing may be omitted, if desired, such as where a two channel 
device is present. For example, the left channel of a multimedia PC may be utihzed for the 
data stream from telephone 832 while the right channel of the multimedia PC may be utilized 
for the data stream from VRU 800 without providing summing of the signals. Additionally 
or alternatively, time delays may be utilized to separately present the information through a 
single resource, such as the aforementioned single speaker of telephone 814. For example, 
gateway 810 may queue a particular data stream, or portion thereof, imtil a null, such as a 
silence in voice information, is detected in another data stream and, thereafter, pass data of 
the queued data stream. 

Another special case of a conference is shown in the preferred embodiment of 
FIGURE 10. In the case of FIGURE 10, various conference participants are in 
communication utilizing links having different characteristics. For example, in the 
embodiment of FIGURE 10 a fiiU duplex call has been established between telephones 814 
and 832. This call may be established as described above. For example, a caller using POTS 
telephone 814 may dial a toll free service access number to thereby be coupled to VRU 800, 
such as via a full or half duplex audio connection (such as media link 824 shown in FIGURE 
4a) and/or a signaling connection, such as signaling connection 1095. VRU 800 may then 
execute an interactive voice script with the caller to provide voice greetings and/or menus and 
thereby acquire/provide information, such as information with respect to a method of 
payment for a call and/or a desired called party. Thereafter, VRU 800 may place a separate, 
secondary call to POTS telephone 832 to thereby couple VRU 800 to telephone 832, such as 
via a flail or half duplex audio connection (such as media link 828 shown in FIGURE 4b) 
and/or a signaling connection, such as signaling connection 1096. Finally, to place telephone 
814 in communication with telephone 832, media sent to VRU 800 is preferably redirected to 
travel directly between the originating gateway 810 and terminating gateway 812 (data 
streams 1091 and 1092), thus bypassing VRU 800. 



844938.1 



47524-P 1 04CP 1 -09908773 



PATENT 



As with the embodiment of FIGURE 9, in the embodiment of FIGURE 10 messaging 
in addition to that provided between telephone 814 and telephone 832 and that of signaling 
connections 995 and 996 is desired. For example, where VRU 800 is adapted to provide 
reduced rate or toll free calling when the callers are amenable to listening to advertising 
promotions or other such messages, VRU 800 may provide data streams to the various 
conference parties. 

Accordingly, VRU 800 opens up another data stream (or maintains an original media 
link) to telephone 814, shown as data stream (or maintains an original media hnk) 1093, and 
another data stream to telephone 832, shown as data stream 1094. At this point telephone 
814 is receiving two data streams, one from the called party at telephone 832 and another 
from VRU 800, Likewise, the called party at telephone 814 is receiving two data streams, 
one from the calling party at telephone 814 and another from VRU 800. However, according 
to this preferred embodiment, as VRU 800 is not actually participating in the conversation, 
but merely broadcasting advertisements or other messages, the data streams between VRU 
800 and telephones 814 and 832 are preferably half duplex. Accordingly, the embodiment of 
FIGURE 10 provides a special case of a conference where various conference participants are 
in communication utilizing links having different characteristics. 

As shown in the preferred embodiment of FIGURE 10, the caller at telephone 814, in 
addition to his conversation with the called party at telephone 832, hears a voice or other 
signal from VRU 800 providing information, such as an advertisement the payment for which 
from its sponsor allows the call service to be provided at a reduced cost or no cost to the 
calling and/or called party. Likewise, in the preferred embodiment of FIGURE 10, the called 
party at telephone 832, in addition to his conversation with the caller at telephone 814, hears 
a voice or other signal from VRU 800 providing information, such as an advertisement from 
a sponsor. The advertisement messages may play continuously or may be played at intervals, 
such as being presented every 30 seconds. 

It should be appreciated that the message directed to telephone 814 and the message 
directed to telephone 832 need not be the same message. For example, VRU 800 may 
include intelligence to determine demographics or other such information, such as through 
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reference to ANI and/or DNI information, to thereby select an appropriate message for 
various ones of the parties. Additionally or alternatively, different messages may be provided 
to ones of the conference parties, such as to provide call status information. For example, 
where the call is a toll call, although possibly reduced in cost due to the advertisements, the 
message to the calling party, or other party responsible for payment, may be informational 
such as to state that "yom calling card balance will be depleted in five minutes," or may 
solicit a response such as to request that the caller "please press *23 if you want to charge 
your credit card another 20 dollars, otherwise your call will be terminated in another 30 
seconds." 

Additionally or alternatively, interactive messages may be provided to various ones of 
the conference parties to allow a degree of call control. For example, a message may be 
provided to each conference party asking the party to "please press *24 if you would like to 
opt out of receiving advertising messages for an added charge." Thereafter, a calling card 
number, or other indication of payment authorization, may be solicited by VRU 800 from 
those conference parties wishing to avoid the receipt of advertising messages during the call. 
Upon a validation of the payment authorization, the data stream from VRU 800 to that 
particular communication device may be torn down. 

It should be appreciated that, as described above, preferred embodiments of the 
present invention utilize a signaling channel separated from the data stream which remains 
estabhshed between the call originator, such as telephone 814, and a service provider system, 
such as VRU 800. Accordingly, responses to the whisper mode messages, such as the DTMF 
key sequence *23 to indicate authorization for credit card charges or the key sequence *24 to 
indicate a desire to opt out of receiving advertising, may be held private from other parties. 

The preferred embodiment of FIGURE 1 1 provides a call recording fimction. For 
example, in the embodiment of FIGURE 11 a fiiU duplex call has been estabhshed between 
telephones 814 and 832. This call may be established as described above. For example, a 
caller using POTS telephone 814 may dial a toll free service access number to thereby be 
coupled to VRU 800, such as via a ftiU or half duplex audio connection (such as media link 
824 shown in FIGURE 4a) and/or a signaling connection, such as signahng connection 1 195, 



844938.1 



47524-P 1 04CP 1 -09908773 



PATENT 



VRU 800 may then execute an interactive voice script with the caller to provide voice 
greetings and/or menus and thereby acquire/provide information, such as information with 
respect to a method of payment for a call and/or a desired called party. Thereafter, VRU 800 
may place a separate, secondary call to POTS telephone 832 to thereby couple VRU 800 to 
telephone 832, such as via a full or half duplex audio connection (such as media hnk 828 
shown in FIGURE 4b) and/or a signahng connection, such as signaling connection 1 196. 
Finally, to place telephone 814 in communication with telephone 832, media sent to VRU 
800 is preferably redirected to travel directly between the originating gateway 810 and 
terminating gateway 812 (data streams 1 191 and 1 192), thus bypassing VRU 800. 

However, in addition to the calling services provided by links 1 191 and 1 192, a party 
to the call, such as a calUng party at telephone 814, may wish some or all of the call to be 
recorded. Accordingly, this party signals VRU 800, such as through using the DTMF key 
sequence *73, to begin recording the call. It should be appreciated that signahng, such as the 
use of the aforementioned DTMF signals, are trapped by VRU 800 according to the preferred 
embodiment and, therefore are not heard by the other parties to the call. Instructions 
regarding the available call options and signaling to instigate them may have been provided 
during an initial connection between telephone 814 and VRU 800. Additionally or 
alternatively, a particular key sequence may be provided which will solicit instructions from 
VRU 800 during the course of communications between telephone 814 and 832, with or 
without suspending the communications between telephone 814 and 832. 

According to a preferred embodiment, when the call record feature is selected, such as 
through the aforementioned key sequence *73, VRU 800 issues instructions for network 
devices to make a copy of the data streams and direct these replicated data streams to VRU 
800, or some other device operating according to the present invention. For example, in the 
illustrated embodiment, VRU 800 signals gateway 801, through signaling channel 1195, to 
replicate the media stream associated with telephone 814 and to direct it to VRU 800 through 
a link such as newly established link 1 193. Similarly, VRU 800 signals gateway 812, 
through signaling channel 1 196, to replicate the media stream associated with telephone 832 
and to direct it to VRU 800 through a link such as newly established link 1 194. 
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VRU 800 preferably records these media streams on non-volatile memory, such as an 
attached disk drive. A most preferred embodiment of the present invention records the media 
streams in a standard format, such as a digital audio "wave" file. The use of such a 
standardized file format facilitates the later use of the recorded information. For example, a 
preferred embodiment of FIGURE 1 1 forwards the recorded information to the party 
instigating the recording, such as through attachment to an e-mail addressed to that party. 
Thereafter, the party may easily play the recording using standard equipment which is widely 
available, such as a PC owned by the party. Of course, there is no limitation that the recorded 
conversation be provided to a calling party. For example, the recorded conversation may be 
provided to all participants and/or to parties not involved in the call. 

It should be appreciated that the data streams received by VRU 800 for recording may 
be summed prior to their recording, such as to provide a single recording of the entire 
conversation. Additionally or alternatively, the data streams may be recorded separately by 
VRU 800, such as to provide discrete files associated with each conference party. Alternative 
embodiments of the present invention may include recording of only a single side of the call. 
For example, rather than establishing both a link fi-om telephone 814 to VRU 800 (media Imk 
1 193) and a link fi-om telephone 832 to VRU 800 (media link 1 194), only a single such link 
may be estabhshed and, therefore, only that portion of the call originating from an associated 
device may be recorded. 

The preferred embodiment of FIGURE 12 provides a call broadcasting fixnction. For 
example, in the embodiment of FIGURE 12 a half duplex call has been estabhshed between 
telephones 814 and 832. This call may be estabhshed as described above. For example, a 
caller using POTS telephone 814 may dial a toll free service access number to thereby be 
coupled to VRU 800, such as via a fiill or half duplex audio connection (such as media link 
824 shown in FIGURE 4a) and/or a signaling connection, such as signaling connection 1295. 
VRU 800 may then execute an interactive voice script with the caller to provide voice 
greetings and/or menus and thereby acquire/provide information, such as information with 
respect to a method of payment for a call and/or a desired called party. Thereafter, VRU 800 
may place a separate, secondary call to POTS telephone 832 to thereby couple VRU 800 to 
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telephone 832, such as via a full or half duplex audio connection (such as media link 828 
shown in FIGURE 4b) and/or a signaUng connection, such as signaling connection 1296. 

Various ones of the above steps may be repeated for each additional called party the 
caUing party wishes the call to be broadcast to. For example, the information provided by 
telephone 814 may have indicated a number of desired called parties. Accordingly, VRU 800 
may place a separate, secondary call to POTS telephone 1232, through gateway 1212, to 
thereby couple VRU 800 to telephone 1232, such as via a full or half duplex audio connection 
(not shown) and/or signaling connection, such as signaling connection 1297. Likewise, VRU 
800 may place a separate, secondary call to multimedia PC 1214, which in the illustrated 
embodiment is coupled to IP network 806 without the use of a gateway, to thereby couple 
VRU 800 to multimedia PC 1214, such as via a full or half duplex audio connection (not 
shown) and/or signaling connection, such as signaling connection 1298. 

According to the preferred embodiment, to place telephone 814 in communication 
with each of telephone 832, telephone 1232, and multimedia PC 1214, the media stream of 
telephone 814 is replicated and is redirected to travel directly between the originating 
gateway 810 and terminating gateway 812 (data stream 1291), originating gateway 810 and 
terminating gateway 1212 (data stream 1201), and originating gateway 810 and multimedia 
PC 1214 (data stream 1202), thus bypassing VRU 800. 

It should be appreciated that the media links illustrated in the preferred embodiment 
of FIGURE 12 are half duplex and, therefore, the caller at telephone 814 is broadcasting a 
message without allowing the other conference parties to participate. Of course, altemative 
embodiments may provide additional or altemative links to those illustrated. For example, 
full duplex media links may be established with respect to some or all called parties. 
Furthermore, a media link may be estabhshed between VRU 800 and telephone 814, such as 
to provide whisper messaging as described above. Similarly, a media stream may be directed 
fi-om telephone 814 to VRU 800 to provide recording of the broadcast as described above. 

The preferred embodiment of FIGURE 13 provides a one- number function, such as 
where an individual provides contacts with a single number which, when dialed, will contact 
the individual by various means, such as by activating a robot that will contact the 
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individual's cell phone, pager, work phone, home phone, personal computer, personal digital 
assistant, and/or the like. For example, in the embodiment of FIGURE 13 a caller at 
telephone 814 may dial a number, such as a toll free number, associated with a particular 
individual he wishes to contact. This dialed number connects the caller with call logic 
operating according to the present invention, such as VRU 800, which preferably estabhshes 
a full or half duplex audio connection (media links 1324 and 1325) and/or a signaling 
connection, such as signaling connection 1395. VRU 800 may then execute an interactive 
voice script with the caller to provide voice greetings and/or menus and thereby 
acquire/provide information. For example, VRU 800 may play a greeting to acknowledge 
that the caller is seeking to contact a particular named individual and to please wait while the 
systems attempts to establish contact. 

According to a most preferred embodiment, the network identifies the call as a one- 
number service call, and routes the call to VRU 800 accordingly. Preferably, when the call is 
received at VRU 800, VRU 800 analyzes the dialed number, and identifies it as a particular 
individual's one-number service number. Accordingly, the network preferably includes 
logic, such as at gatekeeper 808, that maintains a list of numbers that may be associated with 
particular network devices, such as VRU 800. For example, a particular group of calling card 
numbers, 1-800 calling card numbers, and/or 1-800 conference numbers may be associated 
with VRU 800. Accordingly, gatekeeper 808 may cause each such call to be directed to 
VRU800 which will make a determination as to what service to provide to each caller, such 
as through use of DNI information, caller query, and/or the like. 

Upon receiving a one-number call, VRU 800 preferably determines how the identified 
individual is to be contacted. For example, VRU 800 may query a database to determine 
various electronic addresses, such as telephone numbers, IP addresses, e-mail addresses, 
and/or the like, through which to reach the individual These electronic addresses may be 
organized into a hierarchy, such as to provide a set of electronic addresses to be attempted 
first and a set of electronic addresses to be attempted subsequently if contact via the first set 
is unsuccessfiil. VRU 800 then preferably utilizes this information to place calls. For 
example, VRU 800 may substantially simultaneously place a separate, secondary call to 
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POTS telephone 832, to POTS telephone 1332, to pager 1333, and to cell telephone 1334 to 
thereby couple VRU 800 to each of these devices, such as via a full or half duplex audio 
connection (such as media links 1311, 1312, 1313, and 1314) and/or a signaling connection 
(not shown). 

Preferably the outbound calls are each coupled to VRU 800 so that when the call is 
answered, or otherwise responded to, the one-number service may determine if the desired 
party has in fact been contacted. For example, where a voice link is estabhshed VRU 800 
may greet the called party and ask for an indication that this is the intended called party, such 
as through soliciting DTMF and/or spoken responses. According to a preferred embodiment, 
if none of the more immediate calls are successful in reaching the intended party, or if after a 
predetermined amount of time they have not reached the intended party, the system may 
provide feedback to the caller and/or provide options in proceeding. For example, VRU 800 
may announce "Fm sorry. So far we have tried all of the called party's numbers and none of 
them have been successful, but his pager is still open. Please stay on the line if you would 
hke to wait a few minutes for the page to be responded to." However, if a particular call is 
successful in reaching the intended party, VRU 800 may tear down the remaining calls, 
perhaps playing a message such as "Please forgive the intrusion, the intended party has been 
contacted at another number." 

When the intended party is reached, VRU 800 may play an announcement to inform 
him that a one-number caller is attempting to reach him. VRU 800 may then connect the 
caller to the intended individual, may query the intended individual as to whether completion 
of the call is acceptable, may query the intended individual as to a particular number and/or 
time to relay to the caller in order to separately estabhsh communication with the intended 
party, may provide a number and/or time at which the called party may be reached by the 
intended party, and the like. For example, VRU 800 may have queried the caller as to his 
name and thereafter, when the intended party is contacted, play a message announcing that 
there is a call from the named calling party, giving the intended party to option to accept or 
decline the call. If the intended party accepts the call, the media stream from telephone 814 
may then be redirected to the appropriate device. 
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The preferred embodiment of FIGURES 14a-14d define a system in which multiple 
service endpoints are provided at the service provider. For example, it may be desirable to 
provide operator access through VRU 800. Accordingly, the preferred embodiment of 
FIGURE 14a includes operator station 1400 coupled to VRU 800 through links 1401 and 
1402. 

As illustrated in FIGURE 14a a full duplex call has been established between 
telephones 814 and 832. This call may be established as described above. For example, a 
caller using POTS telephone 814 may dial a toll firee service access number to thereby be 
coupled to VRU 800, such as via a full or half duplex audio connection (such as media link 
824 shown in FIGURE 4a) and/or a signaling connection, such as signaling connection 1495. 
VRU 800 may then execute an interactive voice script with the caller to provide voice 
greetings and/or menus and thereby acquire/provide information, such as information with 
respect to a method of payment for a call and/or a desired called party. Thereafter, VRU 800 
may place a separate, secondary call to POTS telephone 832 to thereby couple VRU 800 to 
telephone 832, such as via a full or half duplex audio connection (such as media link 828 
shovm in FIGURE 4b) and/or a signaling connection, such as signaling connection 1496. 
Finally, to place telephone 814 in communication with telephone 832, media sent to VRU 
800 is preferably redirected to travel directly between the originating gateway 810 and 
terminating gateway 812 (data streams 1091 and 1092), thus bypassing VRU 800. 

The system of FIGURE 14a provides for the connection of one or more of the callers 
to a resource at the VRU, such as operator station 1400, to thereby provide particular 
services. For example, VRU 800 may provide a service that allows one of the callers, at any 
point, to transfer the call charges (whether the total charges incurred, the charges incurred up 
to a particular point in the call, or the charges incurred after a particular point in the call) to 
the other end of the call, or to another party. However, to avoid fraud and/or to facilitate the 
transfer of the charges, operation of the system may utilize verification from an operator. 

For example, the calling party may decide that the conversation is no longer of benefit 
to him and that he does not want to incur further charges with respect to the continued 
conversation. The called party may decide that the continued conversation is of benefit to 
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him and, therefore, that he is wilhng to accept the charges associated with the continued 
conversation. According to a preferred embodiment, the caUing party may then signal VRU 
800 that service is desired, such as by keying the key sequence *43 or other signal, and be 
placed in communication with a particular resource coupled to VRU 800, such as an operator 
at operator station 1400, 

It may be desirable to link all or a subset of the callers to the particular resource. For 
example, both callers at telephones 814 and 832 may be placed in voice communication with 
the operator at operator station 1400. Alternatively, a subset of the callers may be coupled to 
the resource, such as one or the other of telephones 814 and 832 coupled to operator station 
1400 at any particular time. Of course, the coupling of a subset of the callers may be 
accomplished sequentially such that a larger subset or even all the callers are eventually 
coupled to the resource. 

According to the preferred embodiment of FIGURES 14a-14d, where a transfer of the 
charges is being accomphshed, the calling party invoking the service, here telephone 814, is 
first placed in communication with operator station 1400 (shown as media links 1493 and 
1497 of FIGURE 14b). Because this preferred embodiment operates to allow the caller at 
telephone 814 to have a private conversation with the operator, it should be appreciated that 
the media links between telephone 814 and 832 have been torn doAvn and telephone 832 is 
provided media link 1451 from VRU 800. In the preferred embodiment media hnk 1451 
provides hold music or messaging to telephone 832 to assure the caller that the call has not 
been terminated, but does not provide any portion of the conversation between telephone 814 
and operator station 1400. Although the data stream coming from operator station 1400 to 
gateway 810 may provide whisper mode communication as discussed above, it is expected 
that the caller at telephone 814 will likely converse with the operator at operator station 1400 
and, therefore, at least media link 1491 should be tom down if privacy is desired. 

An operator at operator station 1400 may solicit information with respect to the 
service the caller at telephone 814 desires. Upon determining that the calling party wishes to 
have fiirther charges with respect to the call transferred to the called party, the operator may 
need to confirm the called party's agreement to this change and/or obtain payment 
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information. Accordingly, telephone 832 may be conferenced into the conversation through 
the use of media streams 1494 and 1498 as shown in FIGURE 14c. It should be appreciated 
that media link 1494 as provided from VRU 800 contains a data stream containing 
conversation components from the conversation between telephone 814 and operator station 
1400. Although the preferred embodiment of FIGURE 4c illustrates media Unk 1451 having 
been torn down and replaced by media link 1494, it should be appreciated that the content of 
the media stream may simply be changed rather than establishing a replacement media link, if 
desired. However, according to the preferred embodiment, a different voice media server is 
utiUzed to provide the ports for music on hold, thereby allowing for the optimized use of 
particular ports, such as those adapted for particular ftmctions needed by a call. 

Of course, interconnection schemes of the media streams different than those 
illustrated to accomplish the conferencing described above. For example, media streams may 
be directed between gateways 810 and 812 with copies of the media streams directed to VRU 
800 and media streams directed from VRU 800 to gateways 810 and 812. However, the 
preferred embodiment utilizes a interconnection scheme as shown in order to facilitate a later 
step wherein private communications are provided between telephone 832 and operator 
station 1400. 

According to the illustrated embodiment, the callers and the operator confer to agree 
that the charges are to be transferred to the called party. Thereafter, the called party may be 
required to give sensitive information, such as a credit card or other payment information. 
Therefore it may be desired to have a private conversation with the called party. 
Accordingly, media hnks 1493 and 1497 may be torn down between VRU 800 and telephone 
814 in favor of media Unk 1452 from VRU 800. Although the preferred embodiment of 
FIGURE 4d illustrates media hnk 1493 and having been torn down and replaced by media 
link 1452, it should be appreciated that the content of the media stream may simply be 
changed rather than establishing a replacement media link, if desired. However, according to 
the preferred embodiment, a different voice media server is utilized to provide the ports for 
music on hold, thereby allowing for the optimized use of particular ports, such as those 
adapted for particular fimctions needed by a call. 
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In the preferred embodiment media link 1452 provides hold music or messaging to 
telephone 814 to assure the caller that the call has not been terminated, but does not provide 
any portion of the conversation between telephone 832 and operator station 1400. Although 
the data stream coming from operator station 1400 to gateway 812 may provide whisper 
mode communication as discussed above, it is expected that the caller at telephone 832 will 
likely converse with the operator at operator station 1400 and, therefore subsequent operation 
should ensure that links are not maintained which carry the conversation if privacy is desired. 

Upon completion of the service requested, links between telephones 814 and 832 and 
operator station 1400 may be torn down in favor of media links allowing the call between 
telephones 814 and 832 to continue. For example, after having received and verified payment 
information, such as a calling card number from the caller at telephone 832, the operator at 
operator station 1400 may allow the call to progress normally utilizing links such as shown in 
FIGURE 14a. 

Although the preferred embodiment described above provides for private 
communication to operator station 1400 for both telephone 814 and telephone 832 and for 
conference communication between telephones 814 and 832 and operator station 1400, 
alternative embodiments may omit one or more of these call situations. For example, if the 
party to which the charges are to be transferred initiates the service, it may be desirable to 
omit a private conference with any other parties and/or even a conference between all the 
parties. 

It should be appreciated that additional service endpoints provided by the VRU, such 
as the above described transfer of call charges, may be provided by means other than the use 
of an operator station described above in the preferred embodiment. For example, a robot 
operator, such as may be embodied in another VRU, may be utilized to provide additional 
services at VRU 800. 

The preferred embodiments described above have been described with reference to 
configurations utihzing a centralized packet VRU or similar circuitry to control the creation 
and tearing down of links and the direction of media streams. The use of such a centraUzed 
system to control the calls may be desirable in preferred embodiment implementations 
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operating according to H,323 protocols to facilitate the designation of the packet VRU as the 
Multipoint Controller (MC), In the scenarios described above, the packet VRU is initially 
involved in the call and, therefore, can designate itself the MC according to H.323 protocols. 
Thereafter, the VRU can create and tear down media streams as needed according to the 
present invention to provide the desired services. 

However, it should be appreciated that a packet VRU system as illustrated in the 
preferred embodiments is not required according to the present invention. For example, 
rather than providing a packet VRU system separate from the calling party and called party's 
equipment, the functionality of the illustrated packet VRU may be embodied in these or other 
network devices. According to one alternative embodiment of the present invention, a party 
utilizing enhanced calling services is provided with a "smart" phone, such as may have a 
processor, memory, packet input/output interface, and instruction set defining operation as 
described herein, providing media control as described above. 

Moreover, it should be appreciated that protocols utilized according to the present 
invention are bidirectional, allowing any appropriate network device, or some combination 
thereof, to be designated as a media controller for some or all aspects of the enhanced calling 
services provided. For example, directing attention to FIGURES 15a- 15c a preferred 
embodiment cooperative call control application wherein conference calling is provided 
through the use of distributed media control is shown. 

In the embodiment of FIGURE 15a a caller at terminal 1514 may dial a number 
associated with a particular individual he wishes to contact. Accordingly, terminal 1514 may, 
preferably operating under control of call application 1503, establish a signaling channel 
between call control 1502 associated with terminal 1514 and call control 1512 associated 
with terminal 1516, operating under control of call apphcation 1513. It should be appreciated 
that call applications 1503 and 1513 and call controls 1502 and 1512 may be processes 
operable upon processors of the respective terminals 1514 and 1516 according to the present 
invention. Alternatively, either or both of the call application and call control of terminals 
1514 and 1516 may be provided discrete from an actual user terminal unit, such as with 
gateway 812 associated with telephone 832. Accordingly, although illustrated as multimedia 
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personal computer systems in the preferred embodiment, terminals 1514 and 1516 may be 
embodied in a number of different ways, including telephones, smart telephones, and the like. 

Preferably, call control 1502 directs a media stream of terminal 1514 to terminal 1516 
and instructs terminal 1516, through call control 1512, to direct a media stream to terminal 
1514 to thereby establish full duplex communications. It should be appreciated that the 
communications may include video, audio, data, or some combination thereof. 

During the communications between terminal 1514 and 1516 it may be decided that 
an additional party should be connected to the call Although terminal 1514 may operate to 
establish the desired additional communication links, substantially as described with respect 
to the VRU of FIGURE 12 described above, the illustrated embodiment of FIGURE 15a 
utilizes cooperative call control such that multiple network devices provide call control. 
Accordingly, directing attention to FIGURE 15b, a caller at terminal 1516 may dial a number 
associated with a particular individual he wishes to contact. Thereafter, terminal 1516 may, 
preferably operating under control of call apphcation 1513, estabUsh a signaling channel 
between call control 1512 associated with terminal 1516 and gateway 812 associated with 
telephone 832. Call control 1512 preferably directs a media stream of terminal 1516 to 
gateway 812 and instructs gateway 812 to direct a media stream of telephone 832 to terminal 
1516 to thereby establish full duplex communications. 

However, it should be appreciated that a full conference call has not been estabhshed 
between terminal 1514, terminal 1516, and telephone 832 as terminal 1514 has not been 
placed in communication with telephone 832, Although terminal 1516 may operate to 
duplicate the media stream received ja^om telephone 832 and direct this media stream to 
terminal 1514, this arrangement may not be a preferred embodiment due to latencies 
associated with the transmission and retransmission of the media stream of telephone 832. 

Accordingly, in the illustrated embodiment, terminal 1516, through associated call 
control 1512, provides control signals to terminal 1514 (call control 1502) and telephone 832 
(gateway 812) to duphcate their respective media streams and direct these duplicated media 
streams to one another. Accordingly, the preferred embodiment provides a media stream as 
shown in FIGURE 15c between terminal 1514 and telephone 832 as well as a media stream 
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between terminal 1514 and terminal 1516 and a media stream between terminal 1516 and 
telephone 832 and thus provides full conferencing among the parties. 

Although conferencing among three parties is illustrated, it should be appreciated that 
the present invention may operate to conference any number of parties. Moreover, this 
conferencing may be accomplished by any number network devices providing some or all of 
the call control as described above, provided that sufficient control is provided to control 
direction, redirection, and duphcation of media streams such that the particular end points 
generating media streams are properly directed. Additionally, it should be appreciated that in 
operation according to the present invention that there is no requirement for the network to 
itself, e.g., network 806, to provide anything more than a communication media as the 
commimication devices may provide the call control as described above. 

It should also be appreciated that the above preferred embodiments may be used in 
combination to provide a desired number of functions/features in a particular call. For 
example, the calling card services of the preferred embodiment of FIGURE 9 may be 
combined with the call recording services of the preferred embodiment of FIGURE 1 1 to 
provide a caller with a desired combination of enhanced calling features. 

It should also be appreciated that the particular configurations of the above described 
preferred embodiments may be varied according to the present invention and are, therefore, 
provided herein as exemplary embodiments of the inventive concepts described herein. For 
example, a full duplex link between telephones 814 and 832 is not a hmitation of the present 
invention. Telephone 814 may wish to simply "broadcast" a message to telephone 814, and 
possibly additional communication devices, and therefore a half duplex link may be 
established there between. Likewise, a half duplex link between VRU 800 and telephone 814 
and/or telephone 832 is not a limitation of the present invention. 

One such alternative embodiment may be implemented when a large number of 
parties participate in a conference call because it may not be desirable to provide full duplex 
communications between all participants. Accordingly, the present invention may operate to 
provide full duplex communications with respect to particular parties, such as those currently 
speaking and/or those initiating the call, and only provide full duplex for other parties when 
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they speak. For example, even though particular participants in the call potentially could 
send data streams to everybody, these participants will not send media streams to any other 
callers until they actually talk, and when they do talk, they will send media streams to all 
participants. 

Of course, the present invention may operate according to embodiments in the 
alternative to those described above, if desired. For example, the VRU may initiate an 
original call to a party, such as providing a wake-up service or at a time preselected for the 
start of a conference, etc. 

Moreover, the use of telephones, such as telephones 814 and 832, is not a limitation of 
the present invention. For example, multimedia PCs, facsimile machines, data processing 
systems, and/or other communication sources/destinations may be coupled to IP network 806, 
with or without the use of gateway devices, such as originating gateway 810 and terminating 
gateway 812. Moreover, such devices may include call control functionality such as that 
found in the above described VRUs and, therefore, it should be appreciated that the above 
described embodiments may be implemented without a VRU as described. Accordingly, any 
combination of such devices may be placed in communication according to the preferred 
embodiments described herein to utilize services such as voice messaging, automated collect 
caUing, international call back, prepaid and post paid calling card, store and forward, one 
number service, find me, follow me, 800/900 service, automated customer service, automated 
agents and attendants, voice activated dialing, prepaid/post paid wireless, conferencing, 
reduced toll rate calling, transfer of toll charges, recording of information transmitted, e-mail 
of recorded call, broadcast transmission, advertisement broadcasting, whisper mode 
communications, and the hke. 

It is understood that a specific implementation of a packet VRU may be accomphshed 
in hardware or software or a combination thereof It is further understood that packet routing 
controlled by the packet VRU generally enables point-to-point connections, multi-party 
conferencing, and broadcast as required. In this way, for example, large conference calls may 
be enabled, or a feed from the conference may be broadcast to facihtate a radio talk show. It 
is further understood that consistent with the present invention, the packet VRU may be either 
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collocated with a gateway (on the packet side) or a gatekeeper, or distant therefrom. While 
not a preferred embodiment in the long term, a packet VRU may also comprise a switched 
interface to, for example, a PSTN. 

It is further imderstood that the exact order of many of the steps outlined in the 
methods discussed herein may be altered, and such alterations are intended to be within the 
scope of the present invention. For example, redirected RTP streams may be set up before or 
after the original RTP streams are torn down. As another example, when connecting multiple 
parties, all the H.323 calls may first be set up, followed by the setup of the RTP streams, or 
each H.323 call and RTP stream pair for a specific party may be set up, followed by the setup 
for another party. As another example, more than one command may be sent before waiting 
for the corresponding acknowledge retum message. As yet another example, one RTP stream 
may be completely redirected, then the other RTP stream redirected, or commands may be 
altemated in some manner in redirecting the RTP streams. In addition, some of the specific 
commands, especially commands in a custom implementation (e.g., !, 5 and 9), may be 
changed and still be within the scope of the present invention. 

In yet another alternative embodiment, for some applications it may be useful to direct 
the control calls to the packet VRU as discussed hereinabove, but to immediately direct the 
media stream to the destination, instead of first directing the media stream to the VRU and 
then redirecting it to the destination. 

It is further understood that while the primary standard discussed above is H.323, 
other standards may be present on a packet network and are intended to be within the scope 
of the present invention. For example. Session Initiation Protocol ("SIP"), Simple Gateway 
Control Protocol ("SGCP") and Media Gateway Controller Protocol ("MEGACO") may 
alternatively be used to implement media redirection. Each standard has somewhat different 
functionality, and each has certain advantages and disadvantages with respect to other the 
standards. 

It is further understood that while the core functionality of a packet VRU is enhancing 
voice communications, it may be possible for any device connected to the packet network 
may communicate with and utilize the enhanced services of the packet VRU (e.g., a fax 
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machine, data modem or telephone via a gateway, or computers or other terminals connected 
to the packet network and executing H.323 protocols). It is further understood that, to take 
advantage of the present invention, a computer user typically requires a multimedia-grade 
computer, including speakers, sound card, microphone and full duplex voice-enabling 
software. Alternatively, the computer may also include a video input useful, e.g., in video 
conferencing. Altematively, the computer user may use a lower capability computer in 
combination with a traditional telephone. It is further understood that there are many ways to 
connect to a packet network, all of which are intended within the scope of the present 
invention. For example, devices with wireless, satellite or cable interfaces may be linked to 
the packet network, and may communicate with and utilize the enhanced services of the 
packet VRU. 

Furthermore, while a PSTN may be shown as being divided into different sections in 
the figures for ease of explanation, it is understood that the sections may all be part of the 
same nationwide or global PSTN, with some areas accessible locally with httle or no variable 
cost, and some areas accessible by long distance at a variable cost in addition to the local 
fixed cost access. 

Although the present invention and its advantages have been described in detail, it 
should be understood that various changes, substitutions and alterations can be made herein 
without departing from the spirit and scope of the invention as defined by the appended 
claims. Moreover, the scope of the present application is not intended to be limited to the 
particular embodiments of the process, machine, manufacture, composition of matter, means, 
methods and steps described in the specification. As one of ordinary skill in the art will 
readily appreciate fi*om the disclosxu-e of the present invention, processes, machines, 
manufacture, compositions of matter, means, methods, or steps, presently existing or later to 
be developed that perform substantially the same function or achieve substantially the same 
result as the corresponding embodiments described herein may be utilized according to the 
present invention. Accordingly, the appended claims are intended to include within their 
scope such processes, machines, manufacture, compositions of matter, means, methods, or 
steps. 
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